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ALTHOUGH MANY spelling investigations 
have been carried out during the past fifty years 
or more, the results achieved in the teaching of 
spelling have not been satisfactory when measur- 
ed by the effectiveness with which children spell 
in situations that call for written expression. The 
memorization of a list of isolated wor ds, the 
principal approach to the learning of spelling in 
the past, failed to produce efficient spell ers. 
Likewise, the attempts to master the study lists 
of the present decade are failing to develop ade- 
quate spelling ability by a large perce ntage of 
M authorities are of the opinion that we 
do have available professional knowledge based 
on research that would go far toward pr e venting 
and solving the spelling problem ifthis knowledge 
had been put into practice in the classroom. In 
view of this situation, the writer was stimulated 
to conduct a classroom experiment utilizing se- 
lected professional knowledge in an attempt to 
improve the spelling ability of the pupils. 


Purpose of This Study 


is study was made (a) to determine the spel- 
Meet of the pupils of a sixth grade cl ass 
through classroom research and experimentation 
and (b to suggest procedures for spelling in- 
struction to meet those needs by utilizing the im- 
plications of scientific investigation and expe rt 
opinion. 

к No attempt is made to present acomplete 
spelling program. It is the opinion of the writer 
that a spelling program, to be most effe ctive, 
must evolve from the needs of а particular group 
of children under the direction and guidance of 
the teacher. However, basic procedures, con- 
Siderations, and generalizations applicable to any 
group in spelling instruction are, the writer be- 
lieves, inherent in the investigation. 


——ÉR ЕЕЕ EE 


* Footnotes will be found at the end of the article. 


Scope and Background of Study 


This study was limited to a suburban consoli- 
dated twelve-teacher school serving the commu- 
nity of Landover Hills, Maryland. With the ex- 
ception of initial data to determine the general 
spelling competence of the school as a whole in 
the spontaneous writings of the children, the 
study was further limited to forty-one pupils of a 
sixth grade class. 

Most of the pupils came from average middle- 
class homes. The average mental age of the pu- 
pils at the beginning of the study in January, as 
determined by the California Test of Mental Ma- 
turity, Intermediate, Short Form, ^ was 145 
months with a range from 115 months to 186 
months. Тһе І. ©. ranged from 7610 136 with an 
average of 104. On the Progressive Achievement 
Test, Form AA," the average grade placement 
for reading vocabulary was 5.5, for reading 
comprehension 6.6, and for language 6. 5. 

The study extended over a period of five 
months from January to June. However, basic 
classroom organization and teaching procedures 
described later in this section had been estab- 
lished in the preceding months of the school year. 


Sources of Data and Procedures 
BOSSE SS са зе ала S TOUCGHUTOS 


Two chief sources of data were utilized in this 
Study. These were (a) the writings of the pupils 
in the school, and (b) the professional materials 
of outstanding educators in the fields of Spelling 
and related areas. 

The writings of the pupils were used as sour- 
ces of data in two ways--first, in determining 
general spelling competency and in error analy- 
Sis; and second, for individual wordlists. The 
use of the individual lists will be discussed later 
in this section. 


The Spontaneous Writings in Grades Ш 
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Through VI. As a means of evaluating the gener- 
al spelling competence of the school as a whole at 
the beginning of the study, each pupil in Grades 
Ш through VI was asked to write a story about 
any topic of interest, no stipulation being made 
as to the length of the story. The children were 
simply asked to spell as well as they could without 
the help of the teacher. Their spelling errors in 
these stories were analyzed in terms of all errors 
made by each grade group, all the errors in the 
group being pooled. 

The Spontaneous Writings of the Sixth Grade 
Experimental Group. For the sixth grade exper- 
imental group, the spelling errors in the January 
Stories were further analyzed to determine: 

1. The actual words misspelled for the grade 
group and for the individual pupils; the repetition 
of errors for all the pupils; and the most fre- 
quently misspelled words. 

2. The types of errors made in the spontane- 
ous writings of the children. 

3. The occurrence of the misspelled words in 
(a) The Pupils’ Own Vocabulary Spellers, 4 (b) A 
Basic Life Spelling Vocabulary, 5 and. (c) The 
2,000 Commonest Words for Spelling. 

Again in June, each pupil of the experimental 
group was asked to write another story. These 
Stories were analyzed as described above and 
comparisons made with the results of the first 
stories. 

The Sources of Words for Spelling Study. To 
meet the individual writing needs of the pupils, 
two main sources of words were us ed. These 
were the textbook based on the writings of pupils 
and the individual pupil lists. 

The Spelling Textbook. The Pupils’ Own Vo- 
cabulary Spellers were selected as the basic text- 
book because their purposes, methods, and word 
lists were in agreement with the purposes of this 
Study. The words used in this series were based 
on the study, A Basic Vocabulary of Elementary 
School Children, by Henry D. Rinsland. 

The complete spelling word list from Grades 
II through УШ was used as an alphabetical refer- 


ence list to which the children referred as the 
need arose. 


The Individual Spelling Lists. 
motivated to write freely ina vari 
An individual list of the words which each pupil 
misspelled was kept ina сага file at his desk, 
Whenever a word was misspelled, it was checked 
with the list from the Spelling series referred to 
above. If the word occurred in this list, it was 
added to the pupil’s file for Study. Local words 
of importance which the child desired to learn 
were also added to this individual list. 

Other Basic Related Pupil Materials, Initial 
data indicated a need for vocabulary development. 
As spelling was emphasized at the level of reading, 
and because of the interrelationship of the lan- 
guage arts, extensive use was made by the pupils 


The pupils were 
ety of situations. 


of the following materials: | 
1. Basic Readers: Curriculum Foundation 
Series. 9 
2. Building Word Power. | 10 
3. Thorndike CenturyBeginning Dictionary. 
The Use of Tests and Measurements. The fol- 
lowing sources of data for evaluation, арене 
and classification and grouping of pupils wer 
used: | 
1. Temple UniversityInformal Spelling In- 
ventory. "e 
2. Teacher constructed informal cei ш 
venionles! using The Pupils’ Own Voc abulary 
ellers. | 
Ы 3. Gates-Russell Spelling Diagnosis Tests.1 
4. California Test of Mental Maturity, 
5. Progressive Achievement Tests. ае 
All these measurements were given at the 2а 
ginning of the study, апа ће first two hey e 
peated, using a different form, at the end о 
eriment. ; 
ыс in Classroom Organization ала 
Instruction. Artley has presentedfive print ny 
applying to the improvement of spelli ng aan 
which have the weight of research behind t aie 
and formed the basis for the classroom ОЕ р, 
zational and instructional procedures of this st¥ 
These are: ЖЕТТІ 
1. Each child develops at his own indy ов“ 
rate, and spelling instruction must be differ 
ated in terms of this rate of development. гше 
2. A spelling vocabulary grow s out seit 
need for expression rather than from a ргер 
spelling list. | > 
е 3, е а like any other subject in the eM 
riculum, has to be taught. рю the 
4. Spelling has been effectively taugh erit 
extent that the learner has been made indepen 
in his spelling ability. Д 
5. Spelling йөне is most effective bes 
the child has a favorable attitude toward spe 
--when he has the desire to spell M epe s 
Needs Revealed by Initial Data. An ear uA of 
amination of data revealed that a € poc ain 
ability existed among the pup E "a end 
spelling needs were highly pun t 
сады E apa iR poseen bey c deren 
ithin the grade. ^ 
ста, 2 needed enriched and ане pe 
i antics of w ; = 
оге one Eho needed amaintenance aon а 
tinuing program in spelling; and the gener и : 
bal and linguistic retarded group who nee rs 
program of word study skills applicable to al js 
language arts. Cutting across groups were pupl 
who needed specific help in the visual, t 
Speech, kinesthetic, and handwriting skills. АТ 
needed an opportunity to write in meaningful sit- 
uations, and each pupil needed an opportunity to 
Succeed at his level of achievement. Brief] у, а 
functional child development approach to spelling 
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was needed. 

A functional approach to spelling required that 
opportunities be provided for writing in natural 
situations and that instruction be individualiz ed. 
These conditions were provided for through the 
center of interest or functional activity unit inthe 
content areas integrated with a unified language 
arts program. 

The Functional Unit Program. The functional 
unit or center of interest program in the content 
areas was characterized by purposeful and satis- 
fying pupil activities--group and individual, a bal- 
anced program of intensive and extensive reading, 
the development of language skills andabilities in 
Social situations, a wise use of many aids to 
learning, the extension and enrichment of inter- 
ests, and critical evaluation. 

The Unified Language Arts Program. А uni- 
fied language arts approach to spelling was made 
on the assumption that the child is integrated and 
that it is the purpose of the school to foster and 
maintain that integration. Test data indicated a 
wide range of language de velopment among the 
pupils, ranging from the third grade through the 
eighth grade. This necessitated differentiation of 
instruction in terms of pupil achievement and 
needs. 

Grouping of pupils was considered a part of an 
integrated language arts program. Three to four 
flexible groups were organized in terms ofthe in- 
structional levels of the pupils. The instruction- 
al level of spelling was synchronized with the 
reading level. | | 

One of the main procedures used for estimating 
achievement and needs in thegroupsituations was 
the informal inventory in reading and spelling. 
These inventories were usedfor two main pur- 
poses. First, they provided a basis for grouping 
children in terms of their group needs, and sec- 
ond, they served as guides to the needs of the in- 
dividuals in the group. 

Other test data already discussed, and teacher 
judgment, were used to supplement the informal 
inventories in the grouping of pupils on levels. of 
achievement. In general, there was little dis- 
crepancy among the various evaluation techniques. 

Plan of Instruction in the Sp elli ng Per iod. 
Daily provision was made for spelling instruction 
using the textbook and the individual lists. Brief- 
ly, the plan of instruction using the textbook was 
the study-test plan for the retarded pupils andthe 
test-study plan for the others. 21 

Since the pupils were grouped for spelling in- 
Struction at the instructionallevel, the usual daily 
plan found in spellers of what to do on particular 
days of the week was disregarded. The group 
simply proceeded as rapidly as possible in the 
time allotted, usually fifteen to twenty minutes a 
day. For example, on any day а group of words 
could be presented in contextual setting as a read- 
ing lesson, since spelling and reading groups were 


on similar levels, and the skill development ex- 
ercises connected with those words completed on 
the same day rather than the following day as 
suggested by the text. 

The learning of the words in the individual list 
was considered the responsibility of the individ- 
ual pupils. Provision was made for individual 
and small group study, usually pairs of similar 
levels or pairs of different levels, depending up- 
on the activity and pupil choice of partner. 

Method of Studying a Word. The studies of 
RusselllT and others showed that multiple and 
complex instructional steps were cumbersome 
and boring for good spellers and confusing and 
ineffective for poor spellers. The method em- 
ployed in this study eliminated all the steps but 
the vitally useful ones. There were only three 
Steps employed which varied slightly to meet the 
requirements of longer words. These steps were: 

l. Look at the word and say it softly. If it 
has more than one part (syllable) say it again, 
part by part, looking at each part as you say it. 

2. Look at the letters and say each one. И 
the word has more than one part, say the letters 
part by part. 

3. Write the word withoutlookingat your book. 

This method centered on intense, uninterrup- 
ted study and analysis of the word. If the pupil 
wrote the word correctly the first time, that was 
an indication he knew it. However, he was asked 
to write it a second and a third Ише to ‘‘stamp 
in" the correct reaction before another word 
was taken up. 

Words from the individuallists were studied 
in the same manner. The teacher checked with 
the individual pupils to dete rmine if the proper 
concepts and common meanings of the words had 
been established. 

Reviews. Research in spelling and child de- 
velopment indicated that periodic review on a 
long list of isolated words was a waste of time. 
Instead, it was commonly agreed that reviews 
become worthwhile whenthere is involved an op- 
portunity for the child to make application of the 
generalizations, techniques, and principles being 
taught. It was the assumption in this study that 
in a classroom organized around functional units 
integrated with the language arts, and the use of 
a textbook series based on the Rinsland study, 18 
natural reviews are experienced daily. 

Reference has been made in this sectionto the 
various data used in evaluation and in classroom 
procedures. The following section presents a 
more detailed treatment and interpretation of data. 


Presentation and Interpretation of Data 


For comparative purposes, the data in the 
tables for January and June are presented to- 
gether. 

The Standardized Tests. Datafromthe stand- 
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ardized tests indicated two important facts. First, 
there was a wide range of ability among the pupils; 
and second, there existed a general verbal and 
linguistic retardation of one to three grades for a 
group of pupils at the lower distribution level. 
Furthermore, the intelligence quotients did not 
correspond with this retardation of the pupils. 
This confirms the findings of Spache that vocabu- 
lary knowledge is a more significant determinant 
of spelling success than is intelligence, particu- 
larly in the first five grades. 

The California Test of Mental Maturity, Short 
Form. 20 This test showed the average mental age 
of the pupils at the beginning of the study was 145 
months with a range from 115 months to 186 
months. Тһе Т.О. ranged from 76 to 136. 

The Progressive Achievement Test, Form AA. 

This test gave the average grade placement 
for reading vocabulary as 5.5 with a range from 
2.9 to 7.9; for reading c om prehension, 6.6 with 
а range from 4. 5 to 9.5; for language, 6.5 with a 
range from 5.3 to 7.2. 

The Gates-Russell Spelling Diagnosis Tests.22 
An analysis of the types of errors along with other 
data, indicated symptoms of difficulty and some 
definite points where instruction should be given. 
However, in an attempt to go deeper into the dif- 
ficulties and their causes, the Gates-Rus sell 
Spelling Diagnosis Tests were given to the lower 
group of pupils. Results of these tests showed a 
general verbal and linguistic retardation of one to 
three years for fifteen pupils. This evidence in- 
dicated a need for a general program of word 
skills which would apply to all the language arts, 
particularly reading and Spelling, and opportuni- 
ties for the use of words in meaningful situations. 

Misspelled Words in Grades Ш to VI. To de- 
termine how well the children in the school as a 
whole spelled, their Spelling errors in the spon- 
taneous writings were analyzed interms of all 
errors made by each grade group, all the errors 


in the group being pooled. Tables I and II present 
data on this type of analysis. 


Misspelled Words at Each Grade Level. In 
writing 35,883 running words in Grades III - VI, 
the children misspelled 5.95 percent of them as 
shown in Table I. А comparison of these results 
with a similar study by Swenson and Cal dwell 
shows that these children spelled better than the 
children of Prairie City. 23 

Also, the increase in the number of running 
words and the decrease in the number of Spelling 
errors in successive grades Indicate growth in 
spelling and language abilities. 


Misspelled Words for the Two Sixth Grades. 


ives an interesting comparison of the 
ecd peris of the school in that the percent 
of total errors is much higher for the other 
sixth grade than for the one d escri bed in pe 
study. On the basis of standardized tests an 
previous teacher judgment, the two groups were 


comparatively equal in ability at the beginning of 
the school term. It has already been pointed out, 
however, that vocabulary kno wl edge is a more 
significant determinant of spelling ability than is 
intelligence, particularly in the first five grades. 

Some other causative factors could be differ- 
ences in classroom curriculum, methods, atti- 
tudes, motivation, and provisions for written ex- 

ression. 

i With the misspelling of only 3.2 words per 
hundred in writing 5,896 words, it appea Es m 
the experimental group had reacheda rather os 
level of achievement in spelling by шешер 
the sixth grade. By comparison, this sixth gra e 
іп misspelling 3. 2 percent of the total runni = | 
words spelled much better than the Prairie pod 
sixth graders who misspelled 5.8 percent of 
total running words. 

Misspelled Words in the Experimental Group 
In order to meet the spelling needs of children, i 
is necessary to know which words are misspelled 
most frequently in the writings of childre ч 
Tables Ш, IV, V, VI,VI апа УШ are pertinen 
to this. ~ 

Different Errors and Repetitions. 'The P 
portion of different and repeatederrors are ars 
marized in two ways in Table Ш. In Columns, 
and 4 of Table III, the errors of different pori 
are pooled into a grade summary. When a 


the 
tain misspelling of a word was tabulated pg t 2 


е 
later, that same word was misspelled by the полен 
child or another child, that same error was сона 
corded among the 30. 8 percent (repetition of Lon 
rors). Thus, 69.2 percent of the spelling (qe 
in January were different errors while 30. REI 
cent were repetitions of errors already Be june 
once each in the 69. 2 percent. лдене E 
June, 66.2 percent of the spelling serit STE 
different for the grade while 33.8 рет 

ncluded once each 

repetitions of errors already 
i nt. g 
i сину ен the proportion of differentand 

marized in terms of the 
repeated errors are sum in Cul 
errors of individual children in Columns 5 and 6 
of Table III. That is, if acertainchild misspell- 
ed a particular word once, it was counted among 
different words misspelled, even though other 
children in the same grade may have misspelled 
the same word. Ап error was counted а repeti- 
tion of the same error in Column 6 only when the 
same child made the same error. 

Data in Table III indicate two important facts 
concerning the proportion of different and repeat- 
ed errors. First, most of the errors are differ- 
ent individual errors; and Second, the errors re- 
peated most frequently are of two Sources, name- 
ly, errors repeated by different pupils, and indi- 
vidual repetitions of the Same errors. A dispro- 
portionate share of the errors are repetitions of 
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ТАВГЕ 1 


PROPORTION OF MISSPELLED WORDS AT EACH GRADE LEVEL IN SPONTANEOUS 
WRITINGS OF PUPILS IN GRADES Ш-ГУ, JANUARY, 1951 


Grade No. of Running General Words, In- Unintelligible Words Total Errors 

Pupils Words cluding Proper Nouns 

No. Percent No. Percent No. Percent 
ш 14 5,269 456 8. 63 25 0.47 481 9.1 
IV 100 7,617 559 7.38 17 .22 576 7.6 
V 84 11, 825 587 4. 93 20 427 606 5.1 
VI 81 11, 172 450 4.03 22 219 472 4.22 
I-VI 339 35, 883 2,052 5.7 84 „23 2,135 5.95 
TABLE II 


PROPORTION OF MISSPELLED WORDS IN SPONTANEOUS WRITINGS 
OF THE TWO SIXTH GRADES IN JANUARY 


ыса = 
Grade No. of Running General Words, In- Unintelligible Words Total Errors 
Pupils Words cluding Proper Nouns 
No. Percent No. Percent No. Percent 
VI Other 40 5,277 268 5.08 14 . 26 282 5.4 
VI Exp. 41 5,895 182 3.08 8 . 13 190 8.2 
TABLE III 


PERCENTS OF DIFFERENT AND OF REPEATED ERRORS IN SPONTANEOUS 
WRITINGS OF PUPILS FOR JANUARY AND JUNE 


—— 
for Grade Grou Percentage for Individual Pupil 
Dat Total No. of Percentage ouy є ag idu upils 
T General Errors Different Words Repetition Different Words Repetition 
Misspelled of Errors Misspelled of Errors 


January 182 69.2 30.8 80.0 20.0 


June 234 66.2 33.8 71.0. 23.0 
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TABLE IV 


126 DIFFERENT WORDS MISSPELLED AND TOTAL ERRORS FOR 
JANUARY IN SPONTANEOUS WRITINGS OF PUPILS 


No. of Misspellings Number of Different Words Misspelled Total Errors 
per Word Frequency Cumulative Frequency Frequency Cumulative Frequency 
1 92 92 (73%) 92 92 (51%) 
2 20 112 (90%) 40 132 (73%) 
3 8 120 (95%) 24 156 (86%) 
4 4 124 (98%) 16 172 (95%) 
5 2 126 (100%) 10 182 (100%) 
TABLE V 


155 DIFFERENT WORDS MISSPELLED AND TOTAL ERRORS FOR 
JUNE IN SPONTANEOUS WRITINGS OF PUPILS 


No. of Misspellings Number of Different Words Misspelled 
с erent Words Misspelled 


Total Errors 

Frequency Cumulative Frequency Frequency Cumulative Frequency 
1 111 111 (72%) 111 111 (47%) 
2 26 137 (88%) 52 163 (69%) 
à 10 141 (95%) 30 193 (82%) 
4 3 150 (97%) 12 205 (88%) 
5 2 152 (98%) 10 215 (92%) 
6 2 154 (99%) 12 227 (97%) 
7 1 155 (100%) Т 


234 (100%) 


RICHMOND 
TABLE VI 
126 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 


JANUARY AND OCCURRENCES IN PUPILS' OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


Word No. of Times Individual Pupils’ Own Vo- Fitzgerald List Dolch List 
, Misspelled Repetitions cabulary Spellers 
Grade Placement 


left 3 2 D 
reindeer 5 4 4 ЕН Y 
excitement 4 2 6 F = 
lawn 4 3 6 F D 
their 4 0 2 F D 
when 4 2 2 F D 
Christmas 3 1 2 F D 
fright 3 2 6 F* = 
friends 3 2 3 F D* 
judges 3 2 1 F* D* 
swimming 3 2 3 F D 
there 3 1 2 Е D 
too 3 0 2 F D 
where 3 2 2 F D 
announcer 2 0 3* pr D* 
airplanes 2 0 3+ F* D* 
Su 2 0 2 F D 
beaver 2 1 5 А 3 
brought 2 0 2 F D 
bears 2 1 2 F D* 
couldn’t 2 1 8 Е D 
didn't 2 0 3 F D 
decided 2 1 2 F D 
hitch 2 1 6 = 2 
haven't 2 0 5 F D 
picnic 2 1 3 F D 
сатта 2 0 3 Е р 
БО РА 1 2 Е р 
Saturday 2 1 3 К р 
stay 2 1 3 F D 
since 2 9 5 S D 
Santa 2 g = Е p 
they're 2 0 р р D 
wait 2 қ 4 г p 
asylum 1 0 Е E 
attention 1 0 : 3 E 
а lot** 1 0 : F B 
a time** 1 0 A p D 
а half** 1 0 : x p 
almost 1 0 Б Е р 
built 1 0 : T p 
before 1 0 2 Us n 
better 1 0 2 r D 
barking 1 0 5 ES р* 


* Indicates derived form or base word in lists. 
** Indicates combined word misspelling. Most difficult one used for grade placement. 
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TABLE VI (Continued) 


126 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 
JANUARY AND OCCURRENCES IN PUPILS' OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


Word No. of times Individual Pupils’ Own Vo- Fitzgerald List Dolch List 
Misspelled Repetitions cabulary Spellers 
Grade Placement 


bed 
berries 
beat 
completely 
close 
chimney 
caught 
coming 
corner 
cheese 
did not** 
dangerous 
daughter 
dodge 
description 
Eve 

fined 

find 
finally 
for 

fight 
fighting 
finish 
floated 
forgetful 
growl 

get 

guide 
heard 
hurrying 
have to** 
haven't 
inner tube** 
if 

know 
laid 
minutes 
mad 
must 
merry 
money 
Martin 
machine 
months 
nolge 

no 
offered 
overboard 


* 


1531 ыы со у> ык N CO со соо 53 45 к 
|o] s Bee мр мар sm nn] Be Be Әј Әј onm) ou 
‘Or: бо: ове 


* 


+ 
+ 
+ 


оо ау н> со оо PO н> по I 
Am mom mpm! 


* 
* 


* 
* 


UUUDUUUUU'UUUUUUUUDOUUUUDUU! 


MA сз ка ка а ванна ра ра ра а аа ы кака dm RB а а а PRP Ба на e ва кілі e кей ей сей жей жей a ыа а уа жей ы а а ыз 
мар uon 5 Cum m у]! ју] ' 


OOOoccoOoocooooooooooooooooooooooooooooooooooooooooo 


Оо C» М cs ыо а WWWWEANNAUINHWAN! 


ооо, 


* [ndicates derived form or base word in lists 
** [ndicates combined word misspelling. Most difficult one used for grade placement. 
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TABLE VI (Continued) 


126 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 
JANUARY AND OCCURRENCES IN PUPILS' OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


11 


Word No. of times Individual Pupils' Own Vo- Fitzgerald List Dolch List 
Misspelled Repetitions саршагу Spellers 
Grade Placement 


ouch 
prison 
porch 
palm 
picked 
road 
rubbed 
repairing 
Rudolph 
reindeer 
rhyme 
remembered 
Second 
Scared 
spilt 
scattered 
smeared 
supper 
sleigh 
squad 
then 
through 
tomorrow 
tried 
they 
think 
turned 
throw 
tale 

the 

teeth 
wondered 
where 
weren’t 


"ыыт nini 


MELLE 
g о 
ж 


OU! 


* 


OcOOcocooooooooooooooooooooooooooooooo 
Qn > соғ 00 C2 со МО PO со C2 C2 МО 1 C2 C2 I 53 1 алі PBI Co -100 WOI 
UUDUCDUDUUSUU'! 


RR PRP RRP ka RRR юы RP EA EA ee а на ра ра ра A ра ра ра ра ра ра ра ра ра = = 


Ут] mmm p! кінінінінінінін ! momo! 


99990 ' 


* Indicates derived form of base word in lists. "m 
Total different words misspelled--126 Total errors--182 Total individual repetitions--36 


Total in Vocabulary Speller, Grades I-VI, 2,726 words, 102 (8195) 
Total in Vocabulary Speller, Grades 1-УШ, 4,067 words, 112 (90%) 
Total in Fitzgerald List of 2, 650 words, 101 (80%) 

Total in Dolch List of 2, 000 words, 96 (76%) 
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TABLE VII 


155 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 
JUNE AND OCCURRENCES IN PUPILS' OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


Word No. of times Individual Pupils' Own Vo- Fitzgerald List Dolch List 
Misspelled Repetitions cabulary Spellers 
Grade Placement 


father 1 5 2 Е D 
piano 6 5 3 F D 
where 6 3 2 F D 
their 5 0 2 F D 
went 5 3 2 F D 
Blue Jay** 4 3 = = = 
hold 4 3 3 F D 
there 4 3 2 F D 
experiences 3 1 5* Е* 2 
from 3 1 2 F D 
happily 3 0 " = " 
sheriff 3 2 Е = 2 
Squirrel 3 2 4 Е р 
tried 3 1 3 F D 
thought 3 1 3 Е р 
~ 3 1 2 Е р 
week end** 3 2 3 Е D 
whales 3 2 T* P 
babies 2 1 3 

baseball 2 0 3 Е A 
boat 2 1 2 F D 
crawled 2 1 5 p* 
eagle's 2 1 5* " = 
every 2 0 2 

for 2 0 2 F Е 
fellowship 2 1 ie F 

front 2 1 % = 
finally 2 0 А Е д 
his 2 0 2 ЈЕ р 
loose 2 1 4 F 2 
marshmallows 2 1 6 F Ж 
memorial 2 1 ы = _ 
neighbor 2 il 

planned 2 0 4 A 4 
rolis 2 T 3* Е* D* 
really 2 0 4 Е 5 
swimmer 2 1 4* Е* р* 
5їорреа 2 0 3* Е р 
too 2 0 2 F D 
truly 2 1 3 F D 
thought it 2 1 4 F D 
then 2 0 2 F D 


* Indicates derived form of base word in lists. 
** Indicates combined word misspelling. Most difficult one used for grade placement. 
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TABLE VII (Continued) 


155 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 
JUNE AND OCCURRENCES IN PUPILS' OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


Word No. of times Individual Pupils’ Own Vo- Fitzgerald List Dolch List 
Misspelled Repetitions cabulary Spellers 
Grade Placement 


upon 
which 


~ ~ 
m 


со со 
ом 


altogether 
ankles 
any others** 
ate 
ashore 
armies 

a boat** 
bowl 
brush 
brought 
couldn't 
corral 
curiosity 
cooked 
captured 
coming 
dived 
dumb 
dressed 
didn't 
don't 
divide 
diamond 
dead 
disappointed 
Epson 
friend 
fighting 
first 
grazing 
gnaw 
gotten 
great 

got 

half 

have 
here's 
happened 
height 
howl 

had 

him 
hundred 
haunted 
hopped 


AN єл со 53 со co DO > Ч DO 53 DID ID OD OS 
* 
Rp ry рт тј 1 нінінін) те 
* 
"999!  UUUGUU! ' COD! 


4 
* 


* 


"бт = Де = о * 


* 


BLLELLLLLLLES LEM E 
ооо! 
ж 


ж 
* 


* 


на на на pa на pa Ra RA ра ра EA A ка ка ка на EA ка ка ка ка ка ка ка юш уш үш а уш үш үш уш уш ра уш на рш рш кш кш ушкш ра а ы 
' ögg! 


оооооооооооооооооооооооооооооооооооососооооооооо 
C» -3 со М tO сл -1 из М М со М бо М 1 ANWN! OQA -34сл к оо со! 
ші унуну! тј] у] тј у] o! 


б" ggg: 


* 
* 


*Indicates derived form of base word in lists. 
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TABLE VII (Continued) 
155 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 


JUNE AND OCCURRENCES IN PUPILS’ OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


Word No. of times Individual Pupils’ Own Vo- Fitzgerald List Dolch List 
Misspelled Repetitions cabulary Spellers 


Grade Placement 


inside 
invaded 
jitterbug 
knew 

kept 
kidnapped 
Knox 
knob 
know 
language 
listen 
loaves 
morning 
myself 
much 
months 
million 
moccasins 
minutes 
magic 
nice 
Negroes 
noise 

no 

owned 
o'clock 
off 

open 
potato 
picked 
rabbits 
ribs 
rattlesnakes 
stayed 
scared 
steps 

she would** 
showed 
surprised 
said 
silver 
stunned 
spotted 
speeded 
stomach 
swimming 
them 
think 


а 


NL 
CHEE Y 


ооо! 


ж 


С› М2 сл > іі сл ОСУІ PPNOW! ос со 1 
ж 
АИ Jo Ио ШШ = ШП 
ж ж 


* 


* 
* 


* 


* 


|o] Az] H3] о rj Hz] IH] Hm] Hn] Во о пој | on] omm Вы? В? әрә). 


'0оооооооомџо' 


ме не -1 Оо МО н> Нь со о со сл по ~ 
жж 
ооо! 
+ 


ооо 
* + 


* 
* 


D* 
D* 


* 
* 


oA ka kA EA н ка ка ка ка ка ка ка ка ка кш кш Ба ш уш ш ш на на на ра ра ра ра ра pa а 
I-A на кн кн EA E кн E ES кн н 
оосооооооооооооооооооооо 
ооооооооооооо 
oooooooooooo 


м BO CO Cn оны! н> DO o CO моњ 
^A mb му у m mp ya! 
оо 


[ДДД 


*Indicates derived form of base word on lists. 
** Indicates combined word misspelling. Most difficult one used for grade placement 
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TABLE VII (Continued) 


155 DIFFERENT WORDS MISSPELLED IN CHILDREN'S SPONTANEOUS WRITINGS FOR 
JUNE AND OCCURRENCES IN PUPILS' OWN VOCABULARY SPELLERS, 
FITZGERALD LIST, AND DOLCH LIST 


Word No. of times Individual Pupils' Own Vo- Fitzgerald List Dolch List 
Misspelled Repetitions cabulary Spellers 
Grade Placement 


times 
they 
taffeta 
toilet 
talking 
until 
unoccupied 
uncle 
village 
writing 
wiggled 
walked 
wheels 
wiener 
while 
worms 
yacht 
zoom 


I NN 
' 
1 


wot 

ш! ay ef ey ty ey | 
og! 

* 


9:09: уои! 
ж ж 


* 


|! 4» 00004» со 1 Whol 


RRR н юы ka ka pa на на на на шы шш ш ыш уш 
! Hj! on 


Ooocooooooooooooooo 


* 
y ЧЫ; >: 
* 


* Indicates derived form of base word in lists. 

Total different words misspelled--155 Total errors--234 Total Individual repetitions--53 
Total in Vocabulary Spellers, Grades I-VI, 2,726 words, 121 (78%) 

Total in Vocabulary Spellers, Grades I-VIII, 4,067 words, 137 (89%) 

Total in Fitzgerald List of 2, 650. words, 118 (77%) 

Total in Dolch List of 2, 000 words, 110 (71%) 


TABLE VIII 


GRADE PLACEMENT, NUMBER AND PERCENT IN PUPILS’ OWN VOCABULARY 
SPELLERS OF DIFFERENT MISSPELLED WORDS IN SPONTANEOUS 
WRITINGS FOR JANUARY AND JUNE 


Grade Not in 
3 5 6 Т 8 Speller 
January 32(25%) 35(28%) 17(13%) 10(8%) 8(6%) 6(5%) 4(3%) 14(11%) 


June 41(26%) 33(21%) 27 (1195) 11(7%) 8(6%) — 11(7%) 5(3%) 18(12%) 


15 


Total 


126 


155 
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TABLE IX 


RIMENTAL 
RTION OF MISSPELLED WORDS FOR SIXTH GRADE EXPE 
PROS ше IN SPONTANEOUS WRITINGS IN JANUARY AND JUNE 


=== 


Date No. of Running General Words Unintelligible Words Total Errors 
Pupils Words No. % No. % №. 7 
January 41 5895 182 3.08 8 118 190 3.2 
June 41 7764 234 3.0 0 . 00 234 3.0 
TABLE X 
DATA ON INFORMAL SPELLING INVENTORY SHOWING LEVELS 
OF ACHIEVEMENT AND MEANS FOR JANUARY AND JUNE 
= 
Date Form Number of Pupils at Different Grade Levels Median Level Mean Level 
of Achievement. Grade: 

1 6 8 
1-1-51 M 1 4 1 3 10 8 3 1 5 4.4 
6-12-51 A 0 0 4 3 
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errors by individual children. 

An interesting fact concerning the data for Jan- 
uary and June is that the percents of different 
words misspelled for the grade group and for in- 
dividual pupils are less in June than in January 
although 1,869 more words were written. 

Frequency of Occurrence of Misspelled Words. 
Data in Tables IV and V offer specific information 
on the source of spelling errors. The first line 
of Table IV is read as follows: There were 92 
different words which were misspelled only once 
inall the stories. These accounted for 73 per- 
cent of the 126 different words misspelled, but 
they comprised only 51 percent of the 182 total 
spelling errors. It is obvious that the few words 
represented at the bottom of Tables IV and V ac- 
count for a disproportionately high percentage of 
the errors in the children's writing. 

Tables VI and VII indicate the specific sources 
of these errors as repetitionsof errors by differ- 
ent children, repetitions of errors by the same 
child, or a combination of both. 

Different Words Misspelled. Different words 
misspelled, the number of times misspelled, in- 
dividual repetitions, and occ Се їп Pupils 
Own Vocabulary Spelling Series, A Basic Life 
Spelling Vocabulary, and Dolch's 2, 000 Com- 
monest Words for Spelling, “У are shown in Tables 
VI and VII, which are self-explanatory. How well 
each list met the needs of the pupils is given at 
the bottom of the tables in percents. If de rived 
forms had been omitted, the percentages would 
have been somewhat less. 

A further analysis of the total misspellings of 
these different words shows that in January 85% 
of the total errors occurred in words in the Pu- 
pil's Own Vocabulary Spellers, Grades I-VI, con- 
sisting of 2, 726 words, and 92% occurred in 
words in the spelling series, Grades I- УШо! 
4,067 words; that 82% occurred in words in the 
Fitzgerald List of 2,650 words; and that 19% oc- 
curred in words in the Dolch List of 2,000 Com- 

st Words, 

“>= for June, 80% of the total errors oc- 
curred in the Pupils' Own Vocabulary Spellers, 
Grades I-VI and 89% in the spelling series; that 
18% occurred in the Fitzgerald List; and that 13% 
occurred in the Dolch List. These tables indicate 
that with the exception of unusual words, proper 
ed forms, and words of low frequen- 
the writing needs of the pup ils are 
t part in the lists. 

he words misspelled 
s of errors 
5”; OF re- 
partic- 


nouns, deriv 
cy of usage, 
adequately met for the mos 
These tables show that t rd 
most frequently were either repetition 
by different children on ‘‘demon wo rd 
petitions of errors by the same child on a 
ular word. | mE 
Occurrence of Misspelled Words in Pupils 
Own Vocabulary Spellers for January and June. 
An examination of Table VIII reveals two impor- 
tant facts, namely, that the spelling needs of the 


pupils cannot be met by a single spelling textbook, 
and that it cannot be assumed that the spelling 
words of the previous grades have been mastered 
by the pupils. For example, 74 percent of the 
different words misspelled in January areina 
grade placement below the sixth grade, and 71 
percent of the different words misspelled in June 
are in a grade placement below the sixth grade. 
Furthermore, 53 percent and 47 percent of the 
different misspelled words in January and June 
respectively, are placed in the second and third 
grades. 

Proportion of Misspelled Words in January and 
June. Evidence on the effectiveness of the pupils’ 
writings in January and June is given in Table IX. 
The reduction in pupil errors of .2 percent over 
the period of five months seems insignificant in 
itself. However, with the increased use of1869 
words and the probability of error among writings 
of sixth grade pupils with as wide a range of a- 
bility as this group had, it is doubtful if the per- 
centage of errors could have been reduced much 
more in a five months period. By comparison 
again, the Prairie City sixth grade pupils made 
2.8 percent more errors thandidthis sixth grade 
group. Also, this group would be equivalent to 
half-way between the seventh and Sight grade of 
the Prairie City school children. 2 

Informal Spelling Inventory Analysis. Oneof 
the best measurements of achievementfor a par- 
ticular group is the informal inventory because 
it evaluates the pupils on materials which they 
have had an opportunity to learn. 

Temple University Informal Spelling Inventory. 
30 Table X is self-explanatory. During the five 
months of the experiment, the pupils made a 
mean gain of 1.3 grades. Themeangain was ac- 
tually higher because five pupils achieved beyond 
the eighth grade. 

Teacher-Prepared Informallnventory. The 
results of the teacher-prepared inventory as giv- 
en in Table XI are similar to that of the one just 
described. It is not possible to give the mean 
because tests were not given beyond the sixth 
grade. Eight pupils scored beyond the sixth 
grade in January and fourteen pupils scored be- 
yond the sixth grade in June. It is interesting to 
note, also, that in January fifteen pupils had an 
instructional level of second and third grade. In 
June this was reduced to four in number indicat- 
ing much progress іп the group which caused a 
majority of errors in the pupils’ writings. 


Summary and Conclusions 


The purpose of this study was (а) to determine 
the spelling needs of the pupils of a sixth grade 
class through classroom experimentation and re- 
Search, and (b) to suggest procedures for spell- 
ing instruction to meet those needs by utilizing 
the implications of scientificinvestigation and 
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TABLE XI 


DATA ON TEACHER PREPARED INFORMAL SPELLING INVENTORY 
SHOWING LEVELS OF ACHIEVEMENT FOR JANUARY AND JUNE 


Date Number of Pupils at Different Grade Levels 
1 2 3 4 5 6 Beyond 

1-1-51 0 5 10 5 8 5 8 

6-12-51 0 1 3 3 10 10 14 


a EE 


This presentation and interpretation of data is given for a particular 
school and a particular grade of that school. The evide nce of this 
data may or may not be applicable to other classroom situations. 
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expert opinion. 

To determine the spelling needs of those pupils, 
four main sources of data were used:1) standard- 
ized tests, 2) informalinventories in spelling and 
reading, 3) analysis of spelling errors in pupils' 
Spontaneous writings, апа 4)the research and 
theory in spelling and related areas. 

Initial analysis of the above data indicated that 
the spelling abilities of the children varied widely 
and that a core of approximately 2500 words made 
up about 95 percent of the words which the child- 
ren used in writing. Moreover, there were three 
groups of pupils within thetotal group that had 
similar levels of achievement and needs. To meet 
the needs of the pupils within these groups, spell- 
ing instruction was integrated with language arts. 
To provide opportunities for using spelling in 
meaningful situations, instruction in the content 
areas was organized around the functional unit or 
experience approach. 

Among the detailed findings of this study, the 
following points seem to be most significant: \ 

1. Spelling instruction, to be most effective, 
must be differentiated in terms of the needs of the 
group and of the individuals within the group. 

2. Vocabulary knowledge isa more significant 
determinant of spelling success than is intelli- 
gence, particularly in the elementary grades. А 

3. A general verbal andlinguistic retardation 
is a major cause of poor spelling. У А 

4. Most of the spelling errors which 5 їхїһ 
grade children make in spontaneous writing аге 
individual errors. 

5. The spelling errors repeated most fre- 
quently are either errors repeated by differ ent 
pupils, or individual repetitions by the same in- 

ivi upil . 
= Шел Мен needed for sixth grade children's 
spontaneous writing can be met, for the most 
part, by a reliable core list supplemented by in- 
dividual word lists checked for frequency of oc- 
ith a valid list. 
Re оға singletextbook for all the 
children in a class does not meet the needs of the 
ем“ cannot be assumed that mastery of spell- 
ing words and word attack skills has been achiev- 
ed and maintained in previous grades. — 4 

9. The informal inventories in spelling ап 

reading are effective aids in grouping of pupils 

els of ability. А 

n 10. Spelling ability is one of a constellation а 
language arts abilities that tend to reinforce eac 

TED The study-test plan of instruction is an ef- 
fective procedure in instructing retarded or vg 
learning pupils, and the test-study plan is an ef- 
fective procedure for the accelerated pupils. | 

12. An analysis of children’s spontaneous 
writings is an effective means for determining 


pupils’ spelling needs. 


13. Many pupils of the sixth grade have not de- . 
veloped an effective method of studying a word. 

14. Incidental learning should be supplement- 
ed by direct systematic teaching, especially in 
the case of difficult words and words of high fre- 
quency of occurrence. 

15. Children, working onlevels of achieve- 
ment and using spelling in meaningful situations, 
tend to have favorable attitudes toward spelling. 

16. Adequate research, for all practical pur- 
poses, appears to beavailable for improved 
Spelling instruction. 

The final conclusion of the writeristhat while 
the functional method was not necessarily better 
for all pupils, it was better than the conventional 
method for many pupils in the class. The func- 
tional method of teaching spelling in a curricu- 
lum organized as described in this Study was 
reasonably effective in meeting the needs of the 
pupils. Individual differences provide opportun- 
ities for richliving. ша democratic society, 
these differences are regarded as assets. 


FOOTNOTES 


1. James A. Fitzgerald, The Teaching of Spell- 
ing (Milwaukee: The Bruce Publishing Com- 
pany, 1951), p. 2. 

2. California Test of Mental Maturity (Los An- 
geles: California Test Bureau, 1950). 

3. Progressive Achievement Tests--Elementa- 
ry Battery (Los Angeles: California Test 
Bureau, 1950). 

4. Arthur І. Gates, Henry D. Rinsland, Ina C. 
Sartorius, and Celeste C. Pearson, The Pu- 
pils' Own Vocabulary Speller, revised edi- 
tion (New York: The Macmillan Co mpany, 
1950). 

5. James A. Fitzgerald, A Basic Life Spelling 
Vocabulary (Milwaukee: The Bruce Publish- 
ing Company, 1951). 

6. Edward W. Dolch, Better Spelling(Cham- 
paign, Ill.: The Garrard Press, 1942), pp. 
257-270. 

7. Henry D. Rinsland, A Basic Vocabulary of 
Elementary School Children (New York: Mac- 
millan Company, 1 F pp. 

8. William S. Gray, Basic Readers: Curricu- 
lum Foundation Series (New York, Scott 
Foresman Company, 1950). 

9. Donald Durrell, Helen Sullivan and Helen 
Murphy, Building Word Power (New York: 
World Book Company, 1945). 

10. Thorndike Century Beginning Dictionary (New 
York: Scott Foresman Company, 1945). 

11. Temple University Informal Spelling Inven- 
tory (Reading Analysis of the Reais СГ, 
Temple University, Philadelphia. 

12. Gates, etal., op. cit. 

13. Gates-Russell Diagnostic Spell ing Tests 
(New York: Bureau of Publications, Teach- 
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ers College, Columbia University, 1937). 

14. California Test of Mental Maturity, loc. cit. 

15. Progressive Achievement Tests, loc. cit. 

16. A. Sterl Artley, ‘‘Principles Applying to the 

` Improvement of Spelling Ability," Elem en- 
tary School Journal, 49: 137, November, 
1948, pp. 137-148. 

17. David H. Russell, Characteristics of Good 
and Poor Spellers; А Diagnostic Study, 
Teachers College Contribution to Education, 
No. 272. (New York: Bureau of Publications, 
Teachers College, Columbia University, 1937). 

18. Rinsland, loc. cit. 

19. George Spache, *'Spelling Disability," Jour- 
nal of Educational Research, 34:561- 586, 


April, 1941. 
20. Loc. cit. 
21. Loc. cit. 
22. Loc. cit. 


23. Ester J. Swenson and Charles G. Caldwell, 
“Spelling in Children’s Letters," Elementa- 
ry School Journal, 49: 224-235, December, 
1948. 

24. Spache, loc. cit. 

25. Swenson and Caldwell, op. cit. 

26. Gates, etal., loc. cit. 

27. Fitzgerald, loc. cit. 

28. Dolch, loc. cit. 

29. Swenson and Caldwell, op. cit. 

30. Loc. cit. 
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PUBLIC ATTITUDES TOWARD EDUCATION 
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THE SEVERE criticism to whichour education- 
al system has been subjected recently has result- 
ed directly in the establishment of a number of 
public investigating groups to examine education- 
al matters. In Canada, these groups are estab- 
lished as Royal Commissions in the particular 
provinces concerned. At present, three are sit- 
ting or have just concluded sittings in four of the 
western provinces. While many educators view 
such investigations as indicative of renewed pub- 
lic interest in their schools, it is the purpose of 
this study to attempt to establish the degree of 
this interest by determining the extent to which a 
small segment of the Alberta population is aware 
of the existence of the Alberta Royal Commission 
on Education and some of this sample's attitudes 
towards the provincial educational system in 


general. 


Method 


приз 5, 1958, between 7 and 9р. т., 
Жым п{ erviewers telephoned 831 жне 
homes іп the Edmonton area. The numbers cal e 
were chosen at random from the numbers listed e 
the back of the Edmonton Telephone Directory an 
were checked in the directory proper toensure 
that each number was for a residence telephone. 
Of the 831 calls made, 225 residents did Шел 
swer ог their lines were busy. These етен 
were calleda second time after a half-hour " e 
val. Forty-four of those answering seg no dira 
gible for inclusion іп the survey because su fa ге 
under the age of eighteen, iei den pos не 
ргоуіпсе, ог unable to speak English. к 15 = 
interviews were not completed because o Meca 
terruptions as the respon d ents еселі =, de 
door, feedingthe baby, or visitors arriv =, к 
cases were excluded from the pampe Baa = 
respondents refused to be interviews , ~ ШО БАП. 
cause they thought the call was a ад Aes 
magazines, encyclopedias, insur anc 5% т 
вропдепсе ада уыш s QUA tior toy 

igious contributions. 
Mel per be bothered. Ё s hould be noted here, 


*This study reports a project с 
during the 1958 Summer 


that the use of the psuedo-telephone survey as a 
sales promotional device constitutes a serious 
threat to the validity of studies made by legitimate 
researchgroups. Evenamongthe interviews com- 
pleted, the prevalence of the ‘‘What’s your gim- 
mick?’ attitude at the end of the interview was 
marked. Onthe whole, however, the interviewers 
reported excellent cooperation from the 158 men 
and 321 women who answered the interviewer's 
questions. Inevery instance, the anonymity of the 
respondent was protected. 

The calls took the form of a structured inter- 
view in which answers to specific questions were 
sought. The interview had three sections: data 
about the respondent, such as age, formal educa- 
tion, children attending school, presence of news- 
papers, radio, and television in the home; ques- 
tions about the Alberta Royal Commission on Ed- 
ucation; and last, questions about the Provincial 
educational program in general. The responses 
were recorded on a specially prepared data sheet 
which also served as the interview outline. Not- 
withstanding the presence of the form beforethem, 
some of the interviewers on occasion neglected to 
ask some of the questions and this was duly re- 
corded. 


Analysis of Data 


The recorded replies on interview forms were 
classified and coded for punching into IBM cards. 
Subsequent analysis of the data was done on the 
IBM type 101 Electronic Statistical Machine. 

It was a hypothesis of this study that there are 
three factorsthat would influence responses to the 
various questions asked. The first of these is 
called ‘‘parental status." The 479 respondents 
were divided into five cat egories based on infor- 
mation given іп the interview. These five catego- 
ries are: 1) single, 2) married with no children 
(N.C), 3) married but with pre-school age children 
only (P. S. O.), 4) married with children attending 
School in grades one through university or under- 
going professionaltraining, such as, nursing 
(C. A. S. ), and 5) married respondents whose chil- 


onducted by the students in the Methods of Educational Research class 
School at the University of Alberta. 
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left school (С. G. U.). 
u 0 broad categorization dealt with the 
amount of formal education the respondent had re- 
ceived. Sixcategories were employed: 1) elemen- 
tary, grades 1-8 (ELEM); 2) highschool, grades 
9-12 (Н. $.); 3) university and/or professional 
training beyond highschool, such as nursing (UN- 
IV.); 4) technical or commercial training beyond 
high school (TECH.); 5) a group consisting pri- 
marily of European-born respondents whose equiv- 
alent educational level was not known (OTHERS), 
and finally, 6) a group who did not state or were 
not asked the level of their formal Schooling by 
the interviewer (NO. ST.) 

The third area of interest was the age of the 
respondents. Theinterviewer in the conversation 
asked the respondent into which of five age groups 
hisorherage fell. For six who would not divulge 
their age, a not-stated category (Not Stated) was 
added. 

The first analysis Sought to establish the ac- 
cess of the respondent to educational information 
and Specifically, information about the Alberta 
Royal Commission on Education. This dealt with 
Such ite ms as regular receiving 
radio and televisioninthe home, 
in Home and School Associations. 

Of the 479 respondents, 455 received the one 
local daily newspaper regularly while only eight- 
een received no paper. The remainder received 
an out-of-town English language paper only ora 
foreign language paper only. 
eighteen listened predom 


of a newspaper, 
and membership 


preference or listened p 
stations via short wave. 
Sons were not recorded. 
382 had access to sets; nin 
responses were not noted, 

The relationship between Home and School As- 
Sociation membership and parental status is ге- 
ported in Table I. Thistable would Suggest that in 
terms of membershipin the Home and School As- 
Sociations, slightly lessthan halfthe parents (47%) 
with at least one child attending school are 
bers, whereas eleven percent of this 
belonged at one time. 

It must be noted at this pointthat the press and 
radio coverage of the Alberta Royal Commission 
on Education has been acknowledged openly by the 
Commission members to be both extensive and 
impartial in their presentation of the briefs placed 
before this Commission. 

It can be concluded from the above that the vast 
majority ofthe sampled population have had ready 
access in some form to information about the 
Commission and its activities and other educa- 
tional matters inasmuch as this information is 


redominantly to for eign 

Responses for six per- 
Concerning television, 
ety-two did not, Four 


mem- 
group had 


is given by the local press and radio-television 
media. On the other hand, information about the 
provincial and local educational policy of a detailed 
and specific nature that one would expect to be 
normally made available through organizations in- 
terested directly in education and represented in 
this study by membership in a home and school 
association, has been made available to only one- 
third of the sampled population. | А 

The first groupofquestions asked by the inter = 
viewers dealt with the Alberta Royal Commission 
on Education (the Cameron Commission). The 
opening question sought to establish awareness of 
the existence of the Commission. И respondents 
did not recognize it at first, the interviewer gave 
certain additional information about the Commis- 
sion and any delayed recognition was recorded. 
These data are reported in Table II. Approximate- 
ly half the respondents in the sample indicated 
that they had heard of the Cameron Commission 
but almost an equal number had not. Twenty-six 
recognized it after additional information was giV- 
en. Clearly, the group with a university or pro- 
fessional formal education меге, asasingle group, 
most aware of the existence of the Commission; 
whereas the respondents with an elementary edu- 
cation were least aware of it. For the remainder 
ofthe categories, the proportion of ‘‘awares’’ to 
“not амагев” was about half. 

It was appreciated, however, that the mere 
recognition ofthe Royal Commission on Education? 
was not sufficient to indicate knowledge of the 
Commission's activities. Those who had heard 0 
the Commission were also as кеа, “What is this 
Commission tryingto do?’ The responses to this 
question classified by degree of correctness of an^ 
Swers are reported in Table III. 0 

It is evident from this table that although 23 
recognized the CameronCommission, only slight- 
ly more than half of this group had any knowledge 
of the objectives of the Commission. Again, it 15 
evident that no marked differences exist between 
the portions of responses of the sampled gu 
categorized by parental status and age, but tha 
the formal education of the respondent does beat 
an important relationshipto knowledge of the Com- 
mission. It would appear that the degree of knowl- 
edge about the Com mission varies directly wit 
the amount of formal education. Of the group with 
а university or professional education, only 4 
quarter admitting recognition of the Commissio? 
had no knowledge of it. For the remainder of the 
categories, this proportion was about half, with 
the exception of the group with only an elementary 
formal education. Three-quarters of this partic- 
ular group who claimed knowledge of the Commis- 
sion did not know what it was trying to do. 

The respondents who recognized the Royal 
Commission either on presentation of its title ог 
alter receiving partial information about it, жеге 
asked what they remembered hearing about the 


ТАВЉЕ 1 


RELATIONSHIP OF MEMBERSHIP IN A HOME AND SCHOOL ASSOCIATION 
TO PARENTAL STATUS (N -479) 


Membership in a Home and School Association 


Response 
Never Currently Had Not 
Parental Status Belonged Belong Belonged  Indicated Total 

Single 48 -- 1 29 78 
Married: 

No Children 53 6 T 8 74 

Children grown up 50 1 6 9 66 

Preschool children only 50 2 4 10 66 

Children attending school 76 91 21 7 195 

Total 277 100 39 63 479 
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TABLE II 


RELATIONSHIPS OF AGE, PARENTAL STATUS, AND EDUCATION TO STATED AWARENESS OF THE EXISTENCE OF THE 
ALBERTA ROYAL COMMISSION ON EDUCATION (N - 479) 


9: 


Have you heard of the Alberta ТЕ Parental Status Formal Education [ Age of Respondent 
Royal Commission on Education ЈЕ Маггїеа 
or the Cameron Commission as 
it is often called? J = = я = % 
2 = E = [5] [^ ы x о јан 5 “i 
Ei D 1 Е в Е. Аста 22272 805183 
Response Category Я ы Е 5 E © = 5 я 2 à 2 £ 
+ - 
Yes 31 27 139 45 16 2 1 13 81 98 36 2 230 
No 37 88 107 7 9 5 4 14 88 77 37 4 220 
Yes, after clues given 9 4 11 8 2 1 -- 3 T 10 6 e 26 
Response Not Recorded 1 - 2 -- -- -- 1 1 1 1 == = 3 
ЕЕЕ 
Тоїа1 18 119 259 60 21 8 6 31 177 186 79 6 479 
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RELATIONSHIPS OF AGE, PARENTAL STATUS, AND EDUCATION TO KNOWLEDGE OF ALBERTA ROYAL COMMISSION ON EDUCATION 


TABLE III 


OF THOSE EXPRESSING INITIAL AWARENESS OF COMMISSION'S EXISTENCE (N - 230) 


What is this Commission 
trying to do? 


Parental Status 


Married 


Formal Education 


Age of Respondent 


я 3 
2 h я о 2 = 9 m Е E 5 + © в 8 
Pm £r a каты ЗЕК ТЕ 
= š : c Ы { > 
Response Category ü = 2) я о а ш в о > 5 я 8 6 2 2 
Meaningless replies 3 3 2 2 8 4 12 1 1 -- «| 1 5 9 2 1 18 
No Opinion (I don't know) 11 10 14 7 24 12 44 4 4 1 1 ni 25 21 13 -- 66 
Confused or Mistaken Identity -- 2 -- 3 5 2 T -- 1 -- -- -- 4 4 2 me 10 
Some Knowledge (Confused 
Concept of Authority) 10 14 9 9 35 T 43 20 6 1 -- 2 28 37 9 1 т 
Thorough Knowledge 3 4 Т 8 23 -- 24 19 2 -- -- 2 14 22 8 абы 45 
Response Not Indicated 4 1 3 2 4 2 9 1 2 -- -- 1 6 5 2 -- 14 
Total 31 34 35 31 99 27 139 45 16 2 1 | 13 81 98 36 
2 230 
FRU NS = 08 
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Cameron Commission. Categorization was done 
in terms ofthe content of their replies in relation 
to education and the Commission itself. Negative 
remarks about the Com mission included such 
comments as ‘‘a bunch of eggheads wasting the 
taxpayer's money."' Positive stat е ments were 
represented by remarks such as, “this is a good 
thing and long over due." Positive and negative 
remarks about education m aterialized in such 
comments as ‘‘seeing what а good job the schools 
are doing, '' to “finding out how poor our schools 
really are." Comments relating to Commission 
personnel referred to specific members of the 
Commission or events involving specific mem- 
bers of the Commission. Incorrect information 
here, as in the previous table, dealt with those 
who mistook the identity of the Commission con- 
cerned, confusing it with such groups as the Liq- 
uor Commission. These data are presented in 
Table ТУ. 

This table confirms the findings of Table II in 
that half of the respondents could not recall hear- 


are followed up. ” 
Table V. 

Table V shows that th 
about the value of the Ro 


; Tespondents with 
cation give a much 


Opinions which are 
predominantly optimistic. By contrast, the bulk 


of the group with only elementary Schooling have 
Only one other group, mar- 
ried respondents with children of school age, 
share the same willingness to commit themselves 
toan opinion. On the other hand, the single 
group inthe Parental Status category andthe ср. 
der 217 group of the “Age” analysis, who ob- 
viously represent a marked overlap in categori- 


zation, showed an unwillingness to make any com- 
mitment regarding the possible value (or lack of 
it) of the Royal Commission on Education. | 
In summary, the effect of widespread reporting 
of the Royal Com mission on Education activities 
has not resulted, for the sample surveyed at least, 
іп any marked awareness of the Commission and 
its activities. Perhaps this reflects a general 
lack of interest in schools by the general public. 
The only factorthat does seem related to interest 
in the Commissionis the amount of formal educa- 
tion received by the respondent. University and 
professionally trained respondents are far more 
cognizant of the Commission's existence, aims, 
and objectives, and are more optimistic of its po- 
tential valuethan are any other group. On the 
other hand, the group with a formal schooling ter- 
minated at the elementary level showed a general 
unawareness of and lack of concern for the activ- 
ities of the Commission. Surprisingly, the cate- 
gorization by "parental status” of married re- 
Spondents with and without c hi ldren enrolled or 
about to be enrolled in School produced, in most 
instances, few differences of the ma gnitude re- 
ported for amount of formal education categoriza- 
tion of respondents. The same results were noted 
for the categorization by age of respondent. | 
The second part ofthe study sought to establish 
the attitudes of the Sample surveyed towards the 
Provincial educational program in general. The 
гез pondents were asked first to give one feature 
of the educational Systemthey thought was weakest; 
next, what they thought was good about the educa- 
tional system; and fina] ly, they were asked to 
make one suggestion that would in their opinion 
improve the caliber of our Schools regardless of 
how good or bad they rated the schools. | 
Obviously, there was а wide variety of replies 
i estions. Consequently, in the 
€gories, it must be emphasized 
nclude both positive and negative 


asked by the int 
ed in Table vr. 


It canbe seen from this table that about a quar- 
ter of th 


е sample had по Opinions about what they 
felt Wrong with the schools. Twenty-four, or five 


percent of the respondents stated they had по crit- 
ісізт of the schools. Dissatisfaction with the 


RELATIONSHIP OF AGE, PARENTAL STATUS, AND EDUCATION TO RECALL OF 
ON EDUCATION OF RESPONDENTS INDICATING AWARE 


TABLE IV 


INFORMATION ABOUT ALBERTA ROYAL COMMISSION 
NESS OF ITS EXISTENCE (N - 256) 


Have you heard of the Alberta 
on 


Royal Commission on Educatii 


Parental Status 


Formal Education 


Age of Respondents 


——4 - 
or the Cameron Commission as i Married 
it is sometimes called? = y 
С : 1 m а єз 2 я 
® 2 о a = : = ы E H + © и i3 =“ 
pls + à B » E | 1 3 E 214 
Response Category @ Z б al ó a ші E о z 5 я ЕЧ б 2 | я 
Nothing 15 5 11 7 24 10 44 3 4 -- 1 8 21 24 9 ө 62 
Can't recall just now 10 13 6 5 25 13 33 9 2 2 -- 3 19 27 9 1 59 
Negative to Commission -- 3 -- -- 4 -- 5 1 1 -- -- -- 3 3 1 -- 7 
Positive to Commission 3 3 Т 5 19 2 16 15 4 -- -- == 1 18 8 -- 37 
Negative to Education 4 5 3 2 14 -- 17 10 1 -- -- 3 8 12 4 1 28 
Positive to Education 2 3 2 6 10 2 12 8 1 -- -- 1 11 9 2 == 23 
Commission Personnel 1 -- 2 2 2 1 4 1 1 = = 1 1 3 2 225 1 
Incorrect Information 4 1 2 3 3 == 6 3 4 -- -- == 7 5 1 be 13 
Response not indicated 1 4 5 3 Ж ЕЈ 13 3 -= T даљи = 1 1 6 = 20 
Г || = 
Total 40 37 38 33 108 31 150 53 18 3 1 16 88 108 42 2 256 
| 
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TABLE V 


RELATIONSHIP OF PARENTAL STATUS, EDUCATION, AND AGE TO CONFIDENCE IN VALUE OF ALBERTA ROYAL COMMISSION 
OF RESPONDENTS INDICATING AWARENESS OF IT'S EXISTENCE (N -256) 


NOILV ONAA 'IVILNSIBINdX3 JO тумипог 


Parental Status Formal Education Age of Respondents ІҢ"? 
What is your frank opinion of it's з 
(Royal Commission's) possible Married i = 
influence on Alberta Education? р Е Ew е 8 
= из 
B S9 B 214 S в n 54 
[5] E о = Е uk g = Б 
Response Category 2 н о 2 2 e с о = E 
Don't know 6 8 2 сы 9 29 28 16 -- 82 
Extremely Optimistic 6 == == xa 1 5 8 3 -- 17 
Optimistic 25 6 -- -- 3 28 40 14 1 86 
Pessimistic 7 1 1 -- -- 6 12 2 1 21 
Emphatically Pessimistic 2 1 -- -- 2 2 3 3 == 10 
Qualified Optimism (Proviso) 6 2 -- -- -- 10 10 2 -- 22 
Neutral (Won't do any harm) 1 -- -- -- -- 2 2 -- -- 4 
Response not indicated -- -- -- 1 1 6 5 2 -- 14 
53 18 3 1 16 88 108 42 2 258 
Ц 


TABLE VI 


RESPONSES CATEGORIZED BY PARENTAL STATUS, FORMAL EDUCATION, AND AGE OF RESPONDENTS WHEN ASKED TO INDICATE 
ONE WEAK FEATURE OF ALBERTA'S EDUCATIONAL PROGRAM (N - 479) 


T 
Parental Status Formal Education Age of Respondents & 
If you had to state one feature |— - 
of our schools that is weakest, Married Б 
what would this be? = Е 
. N о ж 
; 5 о a = : s m H A 8 8 
É à & ЗІҢ“ B o вз © © Жұ 213 
Response Category © [5] я о [5] ш 5 [s o g 5 a E ó 2 в 
ІШ EE 
Don't know, or couldn't say 18 16 25 39 43 64 5 5 2 3 8 48 41 22 3 122 
No criticism of schools 6 4 4 2 8 9 13 1 -- -- 1 2 12 5 4 1 24 
Dissatisfaction over curriculum 14 12 11 11 3" 10 49 15 10 1 -- 6 31 36 12 -- 85 
Dissatisfaction over teaching 
methods 6 13 4 4 27 7 34 10 3 -- -- 4 18 24 7 1 54 
Division of home and school 
responsibilities 1 3 1 1 1 1 4 1 -- -- 1 -- 4 1 2 "e 1 
Extra-curricular activities 2 2 3 1 6 6 4 2 2 -- -- -- 5 1 2 б 14 
Standard of achievement 9 4 8 6 13 9 18 8 2 3 -- 1 15 13 11 d 40 
Standard of teacher qualifi- 
cations 2 3 2 3 10 2 15 3 -- -- -- 8 9 1 1 - 20 
Crowded conditions -- -- -= 1 6 2 4 1 яз -- -- € 2 5 5. m 1 
Lack of discipline 9 11 11 7 35 22 39 8 3 == -- 4 21 32 14 1 72 
Miscellaneous replies 5 4 5 5 10 5 15 5 2 2 - 3 10 12 4 sm 29 
Response not indicated 1 -- 1 -- 3 3 -- 1 -- -- 1 zu 2 3 7 PE 5 
T 
Total ET 74 66 66 195 | 119 259 60 21 8 6 31 177 186 79 6 479 
-- 
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rriculum was the most common com- 
cora Tack of discipline in the schools ranked 
second. Standards of achievement seemed more 
important to the respondents since standards re- 
ceived twice as many responses as did concern 
for teacher qualifications. However, less than 
ten and five percentof the sample indicated stand- 
ards of achievement or teacher qualifications, 
respectively, as primary concerns. By contrast, 
the division of home-school responsibilities which 
included religious training and complaints about 
crowded conditions were noted only by seven re- 
spondents in each case from the total sample of 
479. 

The major relationship evident in Table VI lies 
between the amount of formal education and re- 
sponse. Itisclearly evident here that the amount 
of education does relate dire ctly to the willing- 
ness or ability to respond. It is to be noted that 
respondents with ап elem entary education place 
far more stress on the lack of discipline than do 
those with university or professional trai ning, 
while this latter group shows greater concern for 
the curriculum and teaching methods. 

The responses tothe item which asked the re- 
Spondents to state one feature they thought was 
good about the schools is presented in Table УП. 

The results ofthe “опе good feature" item in- 
dicated that almost three-eighths of the sample 
could not state one feature they thought was good 
about the schools. Moreover, an additional eight- 


5 methods as good features 
of the present schools. Onthe other hand, school 


extra-curricular activities and the schools’ pro- 
vision for individual differences found mention 
by the least number of r €spondents. As noted 
earlier, the nature of the response bears closer 
relationship to the amount of formal education of 


the respondent than either parental status or age 
of the respondent. 


Mark Twain once remarked that ‹ 
talks about the weather but nobody do 
about it.’’ The last question gave res 
portunity to make one suggestion 
their opinion improve the present edu 
tem. It was here more than in eith 
vious questions that the categori 
meaningless in regard to the positive or negative 
aspect of the response. However, when the num- 
ber of responses warranted, anattempt was made 
to differentiate between positive 


and negative re- 
Sponses within a singlecategory. In all, thirteen 
categories resulted, including one for responses 


not reported. While the majority are self-de_ 
Scriptive, two need further clarification. The 


‘Everybody 
es anything 
pondents ор- 
that would in 
cational зуз- 
er of the pre- 
zation used is 


“Administrative Arrangements" category in- 
cludes scholarships, financial equalization, and 
uniformity of curriculum from provinceto province 
and from school to school. The category on Mor- 
al Attitudes and Values includes responses that in- 
dicate the need for religious training, the desira- 
bility of fighting communism, the importance of 
teaching respect for elders, and like responses. 
It should be notedthat unlike the previous two sets 
of answers, all responses were able to “Ін into 
the created categories without recourse to a mis- 
cellaneous category. These data are presented in 
Table VIII. 

The number of respondents who didn't know, 
couldn't say, or wereso satisfied with the schools 
that they would suggest nothing, accounted for 
over a third of the sampled population. Improve- 
ment of teacher qualifications and teaching meth- 
ods was cited most frequently as the one way to 
improve our schools, with teaching Moral Atti- 
tudes and Values least frequently mentioned. AS 
in previous analyses in this study, the amount of 
formal education seems to bear the greatest rela- 


tionship to res ponse than either parental status 
and age. 


Limitations of the Study 


No attempt has been made to an alysethe re- 
ported data exhaustively for relationships other 
thanthosethatare readily evident. The responses 
of the interviewees have been assumed to be valid 
expressions of their opinions and have been cor- 
rectly recorded by the interviewers. The sam- 
pling technique obviously limits the surveyed рор- 
ulationtothose who possess telephones with listed 


numbers, and Significantly more women than men 
answered the tele 


calls were placed. 
ers in newly develo 
presently served p 
these areas are po 


TABLE УП 


RESPONSES CATEGORIZED BY PARENTAL STATUS, FORMAL EDUCATION, AND АСЕ OF RESPONDENTS WHEN ASKED TO STATE 
ONE GOOD FEATURE OF ALBERTA'S EDUCATIONAL PROGRAM (N = 479) 


Tf you had to state one feature of 


Е 


Parental Status 


Formal Education 


Age of Respondents 


our schools that youthinkis good, Married 
what would this be? А | ш { я 2 3 
Response Category | a z o 127) о m ш 2 н о д > са e [e] 2, је 
Don't know or couldn't say 33 31 22 35 60 | 61 89 13 11 4 3 13 74 60 31 3 181 
Nothing good 2 2 3 6 5 1 10 5 -- 1 1 1 9 5 2 1 18 
АП round good job 14 16 18 3 36 2" 49 6 5 -- -- 3 26 33 24 1 8" 
Teachers and teaching 
methods 5 5 2 1 33 9 23 12 2 -- -- 1 19 23 2 1 46 
Curriculum 7 8 3 4 3 20 10 2 2 -- 3 12 16 6 -- 37 
Organization of school system 3 2 5 3 6 1 14 2 2 -- -- 2 1 9 1 15 19 
Physical facilities 2 1 7 5 11 4 19 1 2 -- -- 1 7 14 4 5 26 
Extra-curricular activities 1 3 1 4 3 2 8 1 1 -- -- == 6 B 1 ХЕ 12 
Provision for individual 
differences 1 1 1 1 6 1 T7 2 -- we mes os 2 8 m ~ 10 
Miscellaneous replies 9 5 3 3 16 7 18 7 2 1 1 7 12 12 5 > 36 
Response not indicated 1 -- 1 1 4 3 2 1 Se > 1 >й 3 1 3 В 1 
Total 78 74 66 66 195 119 259 60 27 8 6 31 177 186 79 6 479 
Ц 


"ту La ЯОУЛЯ 


$8 


RESPONSES CATEGORIZED BY PARENTAL STATUS, FORMAL EDUCATION, AND AGE OF RESPONDENTS WHEN ASKED ТО MAKE 


TABLE VIII 


ONE SUGGESTION THAT WOULD IMPROVE ALBERTA’S EDUCATIONAL PROGRAM (М = 479) 


— 
Н you hadone suggestionto make Parental Status Formal Education Age of Respondent 
to improve the calibre of our - 
Educational System, what would Married 
this be? % 
fe А а о ҮС) 
5 [^] = ' : ti Ы E ы - px 
5 о z = = rs a Ё О m a 3 о в 5 й a 
я x a " д ~ х [5] E o S EL | Ф = 8 
Response Category a = [5] ~ o ы ш > LA o = 4 5 a 5 о | 
Don't know, couldn't say 30 28 25 25 47 52 85 5 6 4 3 10 64 46 33 2 155 
Satisfied with present schools 1 4 2 -- 9 7 5 2 1 1 ES ss 5 T 4 -- 16 
Consideration of individual 
differences 2 2 5 2) 11 4 11 5 2 -- -- 2 10 7 3 РЕ 22 
Discipline (more or less of 
same) 7 11 4 5 16 12 25 5 1 -- -- 3 15 17 8 -- 43 
Homework (more or less of 
same) T 1 2 3 6 3 6 1 2 1 € 1 2 8 2 == 13 
Teachers: Qualifications, pay, 
methods T 8 8 6 29 11 31 14 2 -- -- 4 17 30 5 2 58 
Degree of emphasis of pres- 
ent curriculum 4 6 2 4 22 4 24 8 1 1 -- 2 13 15 7 1 38 
Extending curriculum 14 2 3 7 9 5 20 4 5 -- 1 6 14 8 7 -- 35 
Restricting curriculum 2 3 7 4 19 7 19 6 3 -- -- -- 12 18 5 -- 35 
Standards (lower, raise) 1 7 4 5 9 4 14 6 2 -- -- -- 11 12 3 -- 26 
Administrative arrangements 6 -- 1 2 9 3 11 2 2 -- == 2 7 8 -- 1 18 
Moral attitudes and values 1 2 1 2 T 5 6 1 -- 1 == | E 4 8 1 == 13 
Response not indicated 2 -- 2 1 2 2 2 1 -- -- 2 1 3 2 1 -- 7 
--- ae 
Total 18 74 66 66 195 | 119 259 60 27 8 6 | 31 177 186 79 6 479 
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the provincial population do live in the cities of 
Alberta. 


Summary of Findings 


There is one finding of this study that stands 
out above all others. This is the evident lack of 
interestofthe sampled population intheir schools. 
Sizeable proportions of the sampled group within 
the limitations of the survey method could neither 
criticise nor state one good feature of the schools 
nor make asingle suggestion for their improve- 
ment. The establishment of a Royal Commission 
to study the status of educationin Alberta has not 
created a marked demonstration of the typical 
citizen's interest in education even though the 
press and radio coverage of this Commission's 
activities has been considered generally to be ex- 
cellent. When those recognizing the existence of 
this Commission were questioned further, less 
than a quarter of the total group surveyed were 
acquainted, even partially, with its aims and ob- 
jectives. The same proportion ex pressed opti- 
mism about the ultimate worth of such a Com- 
mission. 

This finding is all the more significant since 
any bias in sampling must have emanated from a 
group with a generally higher standard of living, 
access to a greater number and variety of com- 
munication outlets, and whose schools generally 
are staffed with teachers of higher than average 
qualifications and whose curriculum is much 
broader than generally found in the rural areas. 

The study has brought о ut that the amount of 
formal education received by the respondent of 
the sample surveyed relates most closely to both 
knowledge of and willingness to criticise and sug- 
gest ineducat ional matters. Those with the 
greatest amount of formal education demonstrate 
considerably more intelligent awareness than 
those with only an elementary education. While 
analysis of differences of responses in prec 
to ageofthe respondent or to the number of chil- 
dren in the family or the number that have E 
presently are attending or are about to atten 


terest to warrant detailed 
School, are of suchin име 


Statistical analysis of responses, on 
lationships сет evident by inspection have been 
i ed at this time. 3 
eo 2 the purpose of this study to ore 
the reasons for the findings. However, they “~ 
not differ from those of other investigators. fes 
three recent Canadian studies (1, 2, 5), оу, E 
of Brimacombe (2) is similar to the present study. 


His findings are confirmed to а = ae Шу 
this study and suggests that no mar ec арта 
public attitudes has occurred in the in ЕЕ 
year and a half. Moreover, while those pa 


le 
i i hool showed а favorab 
ith children attending sc apes eal ете 


attitude towards the schools in I i 
to that reported by Lindel (6) for St. Louis par 


ents of school age children, the total population 
sampled in this study was found as a group to be 
unable or unwilling to commend their schools. 
Perhaps this is because the public, in general, has 
had no occasion to become concerned, positively 
or negatively, with education and prefers instead 
to leave such matters to the judgment of profes- 
sional educators. It is only those citizensasa 
group having the equivalent or better formal edu- 
cation than these officials who openly question such 
matters. Perhaps the schools themselves, with 
the possible exception of home and school associ- 
ations, have seen no reason to create citizen in- 
terest in education. It may be that what has been 
done in public relations by the schools and similar 
bodies, such as the Alberta Royal Commission on 
Education, has not been of a type suited to the 
general population but has been, as suggested by 
Hines and Grobman (4), more suited to the group 
with university or professional background. As 
stated earlier, this study has not attempted to an- 
swer thesequestions, yetthey seem worthy of fur- 
ther investigation. 

In brief, this study has shown that the average 
citizen is not inordinately interested in the public 
educational system and it may follow as a corol- 
lary that the reportedoutbursts and attacks on ed- 
ucation are perhaps the product of a vocal and in- 
formed minority. 
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SIZE AND COURSE PATTERN 
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IOWA STATE COLLEGE, as a state supported 
educational institution, admits all students who 
graduate from Iowa high Schools, regardless of 
the academic attainment of the student while in 
high school. In recent years, Iowa State College 
has, however, been discouraging students whose 
high School grades averageless than C from en- 
rolling. However, since Iowa State College is a 
State supported institution, if the student insists, 
he will be admitted. 

Students who enroll at Iowa State College rep- 
resent a cross section of the high schools in the 
State of Iowa. А major portion of the secondary 
Schools of Iowa are represented at Iowa State 
College. Graduates of high schools whose en- 
rollments range from 7 to 2,350 attend Iowa State 
College. To ascertain if the students from small 
and large high schools have the same survival- 
attrition ratio and achieve equally well scholas- 
tically is one of the purposes of this study. 

The other purpose of this study was to ascer- 
tain whether the various course patterns avail- 
able in high schools prepared equally wellfor 
entrance to Iowa State College. All students who 
have graduated from Iowa high schools are elig- 
ible for admission to Iowa State College regard- 
less of the courses they havetaken in high school. 


Sources of Information 


The over-all study, of which this was a part, 
was concerned with 1516 non-transfer Iowa pub- 
lic high school graduates who entered Iowa State 
College in the freshman class of 1952. The four 
year high school enrollment for each of the clas- 
Ses was obtained from thelowa Educational Di- 
rectory. For purposes of IBM coding, ten size 
categories were established as follows: 1) less 
than 25; 2) 25-49; 3) 50-75; 4) 75-99, 5) 100-149; 
6) 150-199; 7) 200-299; 8) 300-499; 9) 500-999; 


and 10) 1000 and over. 

For purposes of analysis in this part ofthe 
study, the high school course patterns were divid- 
ed into four classifications as follows: 1) mathe- 
matics-science; 2) college pre paratory; 3) voca- 
tional; and 4) miscellaneous. For a student to be 
classified into the mathematics and science pat- 
tern, a total of at least 12 semesters of mathe- 
matics and science must have been completed. 
These 12 semesters could not include either biol- 
ogy or business arithmetic. The 12 semesters 
included two semesters of ninth grade algebra, 
two semesters of plane geometry, one semester 
of trigonometry, one semester of either advanced 
algebra or solid geometry, two semesters of gen- 
eral science, two semesters of chemistry and two 
semesters of physics. 

In many instances the ninth grade was included 
in the junior high school. Consequently first year 
algebra and general science were пої listed on ће 
transcript. It was assumed, however, thatto 
have been eligible to have taken advanced mathe- 
matics, chemistry and physics, the student would 
have credit for beginning algebra and general sci- 
ence. To be classified in the mathematics and 
science pattern, the student must have completed 
both high school chemistry and physics and six 
semesters of mathematics. 

The college preparatory high school course 
pattern included eight semesters of English, eight 
semesters of social studies and history, twose- 
mesters of algebra, two semesters of plane geom- 
etry and enough other electives to complete afour 
year high school course. In many instances, the 
student classified as college preparatory had tak- 
en two or more semesters of a foreign language, 
such as Latin, French, or Spanish. Another re- 
quirement for eligibility in this classification was 
not more than two semesters of any type of voca- 
tional education course. 


* Journal Paper No. J-3403 of the Iowa Agricultural and Home Economics Experiment Station, Ames, 


Iowa. Project No. 170. 
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To be classified into the vocational category, 
a student must have completedatleast six semes- 
ters in one of the areas of home economics, ag- 
riculture, industrial education or business educa- 
tion in high school. The business curriculum us- 
ually included such courses as typing, shorthand, 
bookkeeping, office practice and in many instan- 
ces a course entitled business law. 

The remaining classification, miscellaneo us, 
was reserved for cases which did not fit into any 
of the foregoing pattern of courses. 

The transcripts were examined for compliance 
with a pattern of courses in the following order of 
preference: 

1. Mathematics and science 

2. College preparatory 

3. Vocational 

4. Miscellaneous 

For example, whenever a stud ent could be 
classified as having a m athematics and science 
pattern and one other, he was placedin the math- 
ematics and science classific ation as it was 
thought that at a technical institution such as Iowa 
State College a mathematics and science back- 
ground might be more beneficial than any other. 

The control variables used for the analysis of 
Covariance in this study were high school size, 
ACE scores and high school grade point average. 
The high schools from which the 1516 students 
graduated were classified into ten categories and 
coded “0” through “9” for purposes of IBM com- 
putation. High school grade point average and 
ACE scores were also classified into ten categor- 
ies and coded “0” through **9". The statistical 
methods followed were those associated with re- 
gression and discriminant analyses. 


Index of High School Size 
= ава әспоо1 Size 


The predominance of small high schools inthe 
State of Iowa can be readily seen by an inspection 
of Table І. Although considerable change took 
place before and during the early 20’sas a result 
of a wave of school district consol idation, this 
change actually resulted in more high school dis- 
tricts, rather than fewer, since this movement 
was in reality a consolidation of a few elementar 
school districts to form a new district which es- 
tablished a high school with a resulting small en- 
rollment. In 1911-12, there were only 260 high 
School districts in the state of Iowa, but in 1931. 
32, as a result of the consolidation moveme nt, 
there were 909 high school districts. Additional 
changes have taken place in recent years as a re- 
Sult of school district reorganization as shown in 
Table І. From the peak number of 909 high 
Schools in 1931-32, the number of high schools 
has been gradually decreasing until in 1957-58 
there were 745 high schools in the state of Iowa, 

Although the number of districts m 


aintainin 
high schools has fluctuated over the years, the 


state of Iowa has been, and still remains, char- 
acterized for its adherence to the practice of 
Small units for high school instruction. The me- 
dian high school size for the school year 1957-58 
was 94 students. This median was, no doubt, the 
highest during the past 50 years although the typ- 
ical high school had almostas greatan enrollment 
during the first decade of the century. The small- 
est median was 57 students in 1921-22 for any of 
the years summarized in Table I. 

The relationship between college achievement 
and size of high school is amajor objective of this 
study. Philosophical conside rations, based on 
some objective evidence and prevailing points of 
view in education, point to acurvilinear relation- 
ship between size of high school and college a- 
chievement regardless of the terms in which such 
achievement is evaluated. 

To test whether the relationship was curvilin- 
ear, a test of significance of quadratic over linear 
regression was made by high school size and cu- 
mulative quality point average. Since this advan- 
tage resulted in significance at the 5% 1еуе!, it 
was desirable to assume some type of curve. Be- 
cause the size of school, for conveni ence, had 
been coded for purposes of IBM tabulation, it was 


expedient to assign indexes of high school size to 
the IBM code. 


It was decided to 
the cumulative quali 
of high school size 


find the relationship between 
ty point average and the index 
based upon some root of the 


tion of the relationship 
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numerically ordered." 
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TABLE I 


PERCENT OF HIGH SCHOOL DISTRICTS IN EACH SIZE CATEGORY FOR THE YEARS 1901 
TO 1958 AND MEDIAN SIZE HIGH SCHOOL AND MELIAN ENROLLMENT 


Size 1901-02 1911-12 1921-22 1931-32 1941-42 1951-52 1957-58 


N-176 N-260 N-852 N-909 N-897 N-827 N-745 
Less 
than 
25 1.0 3.1 16.4 5.8 6.0 3.8 1.5 
25 13.6 11.5 27.6 20.5 20.5 24.3 18.1 
50 25.0 26.9 20.3 26.6 26.6 24.5 19.6 
75 16.6 16.2 12.3 16.4 13.7 14.1 14.2 
100 25.0 21.3 10.2 13.2 15.2 14.7 19.7 
150 8.5 9.8 4.0 4.5 4.8 6.2 7.8 
200 4.6 148 4.6 5,5 4.8 4.5 8.1 
300 5.1 4.2 2.8 4.3 5.0 5.2 6.3 
500 0.6 1.9 1.3 1.8 2.1 1.9 
4.7% 

1000 0.0 0.4 0.5 1.4 13 1.4 
S 
Median 

Size 91 88 57 72 72 12 94 
School 

Median 

Enrol- 134 157 152 232 267 244 308 
ment 


* No breakdown available for these categories for the years 1957-58 


ТАВГЕ П 


INDEX OF HIGH SCHOOL SIZE 


Size of High School ІВМ Code Index of Size Cumulative Quality Point Average 
Less Than 25 0 0 1.25 
25-49 1 1 2.01 
50-74 2 2 2.08 
15-149 3-4 3 2.06 
150-299 5-6 4 2.09 
300-499 T 5 2.04 
500-999 8 6 2.21 
1000 and over 9 7 2.25 
2.12 
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diction study is the selection ofthe criterion. The 
criterion employed should be as valid and useful 
as possible, yet readily obtainable. For purposes 
of the present study, fourcriteria were employed. 

The first criterion was survival-attrition ten- 
dency at the end of the first quarter of college. 
Survival, as here defined, was the tendency to en- 
roll more than one quarter as a student. No at- 
tempt was made in this study to ascertain the 
causes of freshman attrition. Such causes pre- 
sumably might include: 1) lack of scholastic abil- 
ity; 2) lack of motivation for academic proficien- 
су; 3) inadequate counseling; 4) change in econ- 
omic capacity; 5) illness or death; 6) marriage; 
7) transfer to other universities; 8) failure to ad- 
just to a college environment; and 9) many other 
causes or combinations of causes. 

Included in the survival group are freshmen 1) 
who might have been denied registration at ће be- 
ginning of the second quarter by action of the 
Scholarship committee, but who at some subse- 
quent date did re-enroll at Iowa State College and 
2) who had changed educational or occupational 
objectives as indicated by a change in curriculum 
at Iowa State College. 

Of the 1516 freshmen included in the total 
study, 1384, or 91.3% survived more than one 
quarter. The attrition atthe endof the first quar- 
ter does not seem unduly excessive. Although no 
evidence had been assembled in this study to indi- 
cate the magnitude of changes from a curriculum 
in one division to a curriculum in another divi- 
sion, the attrition percentage might have been 
considerably higher if attrition would have been 
defined in terms of the first chosen curriculum. 

The other dichotomizedcriterion was concern- 
ed with graduation-attrition tendency at the end of 
a Нуе year period. Graduation, as here defined, 
was the tendency to graduate and obtain a degree. 
Again, no attempt was made to ascertain the 
causes of student attrition. The causes might 
presumably include those postulated for attrition 
at the end of the first quarter with the added pos- 
sibility of military service. There may be other 
causes or combinations of causes which contri- 
bute to student attrition which are unidentifiable. 

Included in the graduation group were those 
students who were still enrolled at the end of a 
five year period. It was assumed that these stu- 
dents would eventually earn a degree. In many 
instances these students, who were still enrolled, 
were young men who had their educatior 
rupted by military service and upon discharge 
from the military had re-enrolled at Iowa State 
College. Students who had changed from а сиг- 
riculum in one division to acurriculum in another 
division during the five years, but who earned a 
degree from Iowa State College, were classified 
as graduating. | : 

Of the 1516 freshmen included in the total study, 
680 or 44.9% graduated. Although no evidence 


ion inter- 


has been assembled in this study to indicate the 
magnitude of changes from one curriculum to an- 
other, the attrition percentage, no doubt, would be 
considerably higher if attrition again had been de- 
fined in terms of the first chosencurriculum. 

The other criteria employed were quality point 
average at the end of one quarter of college and 
quality point average at the end of a five year pe- 
riod. For each credit earned, a student receives 
quality points, according to the mark attained, as 
follows: A, 4 points; B, 3 points; C, 2 points; D, 
1 point; F, O points. The quality point average 
for each student at the endof the first quarter was 
obtained by dividing the number of quality points 
attained by the number of credits attempted. 

The quality point average at the end of afive 
year period, designated as cumulative quality 
point average, was obtained by dividing the total 
number of quality points earned forthe five years 
by the number of credits attempted for the five 
year period. 

One of the major causes of student attrition is 
an unsatisfactory achievement as reflected by low 
or failing quality point averages. Sinceone of the 
causes of attrition is unsatisfactory achievement 
as indicated by a low quality point average, there 
should be a substantial correlation between sur- 
vival-attrition tendency and quality point average. 
A biserial correlation of 0.325 was found between 
survival-attrition tendency andfirstquarter qual- 
ity point average for students included in this 
study. This correlation was of sufficient magni- 
tude to be significantly different from zero. How- 
ever, it was not as high as one might expect if the 
only cause of student attrition was low quality 
point average. 

The biserial correlation bet ween graduation- 
attrition tendency and cumulative quality point av- 
erage at the end of a five year period was 0. 372 
which was slightly higher than the correlation 
found for the first quarter. The magnitude of 
these correlations would seem to indicate that, to 
alarge degree, the criteria are somewhat differ- 
ent measures of college achievement. 

It should be pointed out, however, that these 
correlations may be smaller than would normally 
be anticipated because the students who transfer- 
red to other universities were placed in the attri- 
tion category. Another factor contributing to the 
lowering of the correlations isthe unreliability of 
the four criteria. 

The purpose of secondary educ ation has been 
stated in terms of developing the person into an 
effective member of a democratic society. The 
criteria here chosen are useful in evaluating the 
effect of various high school course patterns and 
Size of high school in only one respect, that of 
preparation for study atIowa State College. It is 
not the purpose of this study to evaluate the var- 
ious high school course patterns in terms of the 
Objectives for which they may have been designed. 
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The four criteria, however, constitute legiti- 
mate standards of evaluating the size of high 
School and high school pattern from the viewpoint 
of potential students at Iowa State College. These 
students represent approximately one in every 
twelve graduates of the public high schools inIowa. 


Findings 


To ascertain whether the s ize of the high 
School from which a student graduated had any 
significant effect on achievement at Iowa State 
College, a sample of 180 cases was drawn at ran- 
dom from the 1516 included in the total Study. The 
sample of 180 cases was used in an effort to min- 
imize the effects of the confounding of high school 
Size and high school course pattern. Аз сап be 
Seen by Table III, agriculture appears to bea 
course pattern offered predominantly in the mid- 
dle size high Schools, whereas industrial educa- 
tion, to the degree necessary to be included in 
this study, is offered mostly in the larger high 
Schools, 


To obtain enough cases from each of the course 
patterns for anal 
Sified into three categories: under 100 » 100-499, 
To further sim- 


terns were combined into one pattern, classified 
Thus, for the analyses, the four 
high school Course patterns of math ematics and 
Science, college preparatory, vocational and mis- 
cellaneous were used, " 

Disproportionality existed among high school 
Course patterns and high school size as Shown by 
Table IV. There were only 15 of the 1516 students 
included in this Study who entered Iowa State Col- 
lege from high schools of under 100 withthe math- 
ematics and science coursepattern, whereas 
there were 197 students who enter ed Iowa State 
College from high schools of 500 or over with this 
Same course pattern. However, the largest num- 
ber of students who entered Iowa State College 
with the miscellaneous Course pattern came from 
smaller size schools. The confounding effect of 
high school course pattern and high school size is 
indicated by a chi Square of 242 which is signifi- 
cant far beyond the 1% level. 

In order to eliminate 
between high school si 
pattern, the number 


group of 1516 students yielded a value of -0.184 
which was significantly different from zero. Thus, 
it would appear from this correlation that hi gh 
School grades are partially afunction of high 
school size. It isa negative relationship, mean- 
ing that students from smaller high schools tend 


to have higher high school grade point aver ages. 


A correlation coefficient com puted between the in- 
dex of high school size and ACE scores yielded a 
value of 0.055 which was not significant with 1516 
students. | 

The correlation between the index of hi gh 
School size and the four c ri teria are shown in 
Table V. The correlations are shown without con- 
trol, with control on ACE Scores, with control on 
high school average and with control on both ACE 
Scores and high school grade point average. 

The coefficients between the index of high 
School size and the two dic hotomized criteria 
were not significant, r egardless of what other 
variable or combination of variables were control- 
led. However, with the two c riteria of quality 


high school grade point averages. 
It appears that whenever high school grade 


ontrolling variable 
eindex of high 


ех of high school 
and high school grade point a 001 size 
variables, the index of h ho 35 control 


i n tendency at the 
TSt quarter of College, The ins 
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TABLE III 


PATTERN OF COURSES OF STUDENTS AT IOWA STATE COLLEGE 


BY HIGH SCHOOL SIZE 


43 


d Math. - Ag. Home College Industrial Business Misc. Total 
Science Ec. Prep. Ed. 
Less 
Than 
25 0 0 0 0 1 1 1 3 
25 3 1 2 13 0 22 27 68 
50 6 13 7 30 5 34 48 143 
75 6 14 6 39 0 32 40 137 
100 18 35 9 57 T 28 56 210 
150 16 16 4 32 3 11 12 96 
200 38 26 8 39 8 12 9 140 
300 73 30 5 67 16 16 21 228 
500 118 7 1 86 48 23 11 294 
1000+ 79 о 8 69 24 5 12 197 
Total 357 145 50 432 112 184 236 1516 


Size 


Under 100 
100-499 


500 or more 


Total 


TABLE IV 


PATTERN OF COURSES OF STUDENTS AT IOWA STATE 
BY THREE HIGH SCHOOL SIZE CATEGORIES 


Math. -Science 


15 


College Prep. Vocational Miscellaneous Total 
82 138 116 351 
195 236 98 674 
155 116 23 490 
432 490 237 1516 
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TABLE V 


COEFFICIENTS OF CORRELATION BETWEEN THE INDEX ОЕ 
HIGH SCHOOL SIZE AND THE FOUR CRITERIA 


Criterion No Control Within Pattern 


Correlation with Control 
ACE HSA oth 


Both 
First Quarter 


Quality Point 0.158 0.015 0.232 
Average 


0.181 
Cumulative 


Quality Point 0.090 0.006 0.197 


0.152 
Ауегаре 


Survival- 


Attrition 0.180 0.018 0.074 
Tendency 


Graduation- 
Attrition 0.079 0.012 


Tendency 
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age of students surviving past the firstquarter for 
the four high school course patterns were: 


Mathematics-science 95. 6% 
College preparatory 97. 8% 
Vocational 91.1% 
Miscellaneous 82.2% 


An analysis of the course patterns yielded an 
F-value of 40. 8 which was significant well beyond 
the 1% level. Thus, from an analysis in which 
high school size, ACE score and high school 
grade point average were ignored, it appeared 
that the high school pattern of courses had an ef- 
fect on survival-attrition tendency at the end of 
the first quarter of college. 

A discriminant equation to predict the chances 
in 100 of any given student surviving pastthe first 
quarter was developed. Even though the index of 
high school size contributed but little to predic- 
tion, it was included along with the ACE score and 
the high school grade point average for predicting 
survival. А 

Because the analysis of variance of survival- 
attrition tendency among high school course pat- 
terns does not take into account differences in 
high school size, ACE score or high School aver- 
age, the more refined technique of analysis of co- 
variance was used to control on these variables. 
The analysis of covariance among high school 
course patterns was computed and an F-value of 
39.7 was obtained. This F-value was significant 
well beyond the 1% level, indicating that with con- 
trol on high school size, ACE score and high 
school grade point average, the high school pat- 
tern of courses had an effect on survival attrition 
tendency for the first quarter of college. 

The index of high school size makes little con- 
tribution to either prediction or control when the 
effects of the confounding with course pattern are 
eliminated. For this reason, analysis of соуаг- 
jance was computed without t he use of the high 
school size as a control variable. This F-value 
was not appreciably different from that attained 
when three control variables were used. е 

When using the criterion of BUVA 
tendency at the end of the first quarter, the index 
of high school size has little value for predicting 
survival or as a control variable for the analysis 
of covariance among high school course patterns. 
However, the chances of a student surviving past 
the first quarter at Iowa State College varies with 


the high school pattern of courses. 


First Quarter Quality Point Average 


The other criterion employed for e valuating 
student progress at the end of the first quarter 
was quality point average. The mean xs quars 
ter quality point averages for the four high schoo! 
course patterns were: 

Mathematics-science 

College Preparatory 


2.53 
2.41 


Vocational 2.17 

Miscellaneous 1.60 

An analysis of variance of the course patterns 
yielded an F-value of 11. 0 which was significant 
beyond the 1% level. Again, whenhigh school 
size, ACE score and high school grade point av- 
erage were ignored, the pattern of courses a stu- 
dent completed in high school nad an influence on 
quality point average at the end of the first quar- 
ter. 

A regression equation was developed for pre- 
dicting a first quarter quality point average for 
any given student using the three variables of high 
School size, ACE score and high school grade 
point average. The loss due to the elimination of 
the index of high school size was computed and an 
F-value of 6.0 was obtained which was significant 
at the 5% level. А partial coefficient of correla- 
tion between the index of high school size and first 
quarter quality point average, holding constant 
ACE score and high school grade point average, 
was 0.181. However, both the F-value and the 
correlation may have been unduly high due to the 
possible bias suggested by a significant correla- 
tion between the index of high school size and the 
high school grade point average. Because of the 
possibility of this bias existing, another regres- 
Sion equation was developed without the index of 
high school size. 

The more refined technique of analysis of co- 
variance was used to control on high school size, 
ACE score and high school grade point average. 
The analysis of covariance of first quarter qual- 
ity point average among high school course pat- 
terns yielded a nonsignificant F-value. Evidence 
from this group of students failed to reveal any 
difference among high school course patterns when 
evaluated in terms of first quarter quality point 
average for students who are statistically equated 
on high school size, ACE score and high school 
grade point average. 

The high school pattern of courses had little 
effect on first quarter quality point average when 
either of the two variables of high school size or 
high school grade point average were used as con- 
trol variables. However, when ACE score alone 
was used as a control variable, the high school 
pattern of courses had an effect on thequality 
point average a student earns at the end of the 
first quarter of college. 

Too much confidence should not beplaced in 
Student achievement, either survival-attrition 
tendency or quality point average, when evaluated 
at the end of one quarter of college. It would 
Seem reasonable to expect that the reliability of 
the criteria would be increased as evidence is ас- 
cumulated over a longer period of time. 


Graduation Attrition Tendency 


Survival past the first quarter is an indication 
of eventual graduation. However, it isno guaran- 
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raduation as evidenced by the fact that less 
Шел of the students who survived the first 
quarter evantually graduated. The percentage of 
students graduating from Iowa State C ollege for 
each of the four high school course patterns was: 


Mathematics-science 57. 8% 
College preparatory 62.2% 
Vocational 51.1% 
Miscellaneous 26.7% 


An analysis of variance of the course patterns 
yielded an F-value of 5.4 which was significant at 
the 1% level. From an analysis in which high 
School size, ACE score and high school grade 
point average have been ignored, it appears that 
the high school pattern of courses hadan influence 
оп graduation-attrition tendency at Iowa State Col- 
lege. Equations were developed utilizing: 1) the 
high school size, in addition tothe ACE score and 
high school grade point average and 2) the ACE 
Score and high school grade point average alone. 

The index of high school size did not contribute 
much as a prediction variable as none of the par- 
tial coefficients of correlation were significant. 
А multiple correlation between the index of high 
School size and ACE score with graduation-attri- 
tion tendency was 0. 3155, whereas the correlation 
between ACE score alone and graduation-attrition 
tendency was 0. 3153. 

The amount that the Sigma value would change 
from the largest to the smallest size high school 
is only 0.028 which would seldom change the grad- 
uation percentage more than two percent. This 
Slight difference would be of no practical usein 
the counseling of students. 

Because analysis of variance does not take into 
account differences in student ability, themore 
refined technique of analysis of covariance was 
used to control on high school size, АСЕ score 
and high school grade point average. When these 
three variables were used as controls, the high 
School pattern of courses had no significant influ- 
ence on graduation-attritiontendency. Another 
analysis of covariance was computed using ACE 
Score alone as a control. When ACE score alone 
was used as a control, the hi gh school pattern of 
courses affected the graduation-attrition tendency 
at Iowa State College. 

When using the ctiterion of graduation-attrition 
tendency at the end of a five year period, the in- 
dex of high school size has little valuefor predict- 
ing graduation or as a control variable for the an- 
alysis of covariance among high school course 
patterns. If ACE score alone is held constant, the 
chances of a student surviving the first quarter ог 
graduating from Iowa State College varies with the 
course pattern which he completed in high school, 


Cumulative Quality Point Average 


The other criterion em: 


ployed for eval i 
student progress at the en Ф 


dofafive year period 


was cumulative quality point average. The mean 
cumulative quality point averages for the four high 
school course patterns were: 


Mathematics-science 2.39 
College preparatory 2.33 
Vocational 2.29 
Miscellaneous 1.63 


An analysis of variance of the course patterns 
yielded an F-value of 10. 41 which was significant 
at the 1% level. When high school size, ACE 
Score and high school grade point average Were 
not considered, the high school pattern of courses 
had an influence on cumulativequality point aver- 
age at Iowa State College. 

Again, regression equation were developed for 
predicting an individual student's cumulative qual- 
ity point average. One regression equation was 
developed using the three variables of high school 
size, ACE score and high school grade point av- 
erage. Other equations were developed without 
the use of high school size. 

Analysis of covariance among high school 
course patterns was used to control on the index 
of high school size, ACE score and high school 
grade point average. With these three variables 
controlled, the analysis yielded a nonsignificant 
F-value. Another analysis of covari ance was 
computed using ACE scorealone asa control var- 
iable. This analysis yielded ап Е - value which 
was significant at the 5% level, It appeared that 
the quality point average which a student earned 
varied with his high school pattern of courses 
when ACE score alone was held constant. 


in th , 
nest. e Student’s 


А No direct evidence was 
available to зи i i inci 

Some indirect Ps аг — gem en 
high schools te 
larger high sc 
Correlation of -0.184, 


oes not Р 
lation that Чо necessarily follow from this corre- 


of school. үтүө of grading varies with size 


rawing a better calib that Iowa State College is 


: ge high schools. This 
» When we Оп does not seem tenable, how- 

5 between A the nonsignificant correlation 
ol. CE score and Size of high 


TABLE VI 


PERCENTAGE CONTRIBUTIONS TO VARIANCE OF COLLEGE 
ACHIEVEMENT BY PREDIC TION VARIABLES 


Criterion 


Survival- 
Attrition 


First Quarter 
Quality Point 


Graduation- 
Attrition 


Cumulative 
Quality Point 


Index of High High School ACE Score High School Grade Unexplained 
School Size Course Pattern Point Average 
0.2 65.4 1.4 2.9 30.1 
0.8 0.5 12.9 33.0 52.8 
0.1 3.0 6.4 8.8 81.7 
0.4 1.0 9.9 32.2 56.5 


аоннјул 
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College Achievement and Size of High School 


Little evidence can be found concerning the re- 
lationship of size of high school to collegea- 
chievement except in a sample in which the con- 
founding effect with high school course pattern has 
been eliminated. This has been done in the fore- 
going analyses by reducing the number of students 
in the study from 1516 to 180. 

In this sample, the contributions to the vari- 
ance of college achievement by size of high school 
has been computed and is shown in Table VI. It 
can be seen that in no case does the percentage 
contribution of high school size reach one percent 
when index of high school size, ACE Score, high 
School average and high school Course patternare 
considered. The negative relationship bet we en 
the index of high school size and high school grade 
point average sugeests that the bercentage con- 
tributions of the index of high school Size, small 
though they be, are inflated. If the contribution 
of high School Size is determined when only ACE 
Score and high school course pattern аге consid- 


ered, the contribution of the index of high school 
Size in no case reaches one-t 


This suggests that the Size of 
Self, is almost unrelated to c 


Summary 


Because disproportion 


| ality existed between the 
Size of the high school fr 


om which a Student grad- 
uated and the high school course pattern, a sam- 


ple of 180 cases Was drawn at random from the 
total Sample of 1516 students. When using the 
Criterion of Survival-attrition tendency, the size 


of the high school had little value as a prediction 
variable or as a control variable in the analysis 
of covariance. However, the chances ofa student 
surviving the first quarter varies with the high 
School pattern of courses which he completed. 

When achievement is evaluated in terms of 
quality point average at the end of the first quar- 
ter, the size of high school haslittle value as a 
prediction variable or as a control variable inthe 
analysis of covariance. When ACE score alone 
was held constant, the first quarter quality point 
average varied with the pattern of high school 
courses completed. 

When graduation-attrition tendency is used as 
а criterion to evaluate student achi evement, the 
high school size has little value for predicting 
graduation or as a control variable when using an- 
alysis of covariance. When ACE Score alone was 
held constant, the chances of a student graduating 
varied with the high school course pattern. 

When cumulative quality point average is used 
to evaluate student achievement, the size of the 
high school may be disregarded. When АСЕ 
score alone was held constant, the cumulative 
quality point average varied with the high school 
pattern of courses. 

From analysis on a proportional sample, it ap- 
pears that the size of the high school from which 
à student graduated has little influence onachieve- 
ment at Iowa State College whenthe confounding 
effect high school size and course patternis elim- 
inated. The pattern of courses astudent com- 
pletes in high school greatly influences his a- 
chievement at Iowa State College. It seems rea- 
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A STUDY OF UNDERGRADUATE RECORDS 


OF GRADUATES FROM HUNTER COLLEGE 
WHO LATER EARNED DOCTORATES 


EDITH B. CHASE 
Hunter College, New York City 


IN THE FALL of 1957, the Office of Scientific 
Personnel of the National Academ y of Sciences 
and the National Research Council sent to each 
college a list of its graduates who had been а- 
warded the doctorate by other institutions between 
the years 1936 and 1956. With this list were 81V- 
en for each individual the date of the baccalaure- 
ate and the field and date of the doctoral degree. 
This information seemed to offer an excellent op- 
portunity to ascertain for a com plete group of 
students who came from a single undergraduate 
body and who later earned the doctorate, the de- 
gree to which the quality of undergraduate work 
indicated potential doctoral material, and to de- 
termine any differences bet we еп the records of 


plines. | | 
Of the 304 names on the list, ten were omitted 


{ог various reasons. Of the individuals included 
in this study, all but 13 were women, for, until 
veterans were admitted in 1946, malest udents 
were limited to а Very small number in the even- 
ing session. From the undergraduate record of 
med in the list, the following data 
Cumulative index (each credit of 
ing 4 points, B three points, C two points, 

р нек зла Е по points); Index of first se- 
mester; Index of courses in the field of the future 
doctorate or of the major, if related to the doc- 
torate (i. €., Chemistry major (ог е Iw pipes 
i i ‚ High schoo - 
Biochemistry); q obe ді Peta Карра, Sob tes 


ded); Honors 

Phi 2-1 Kappa, summa Cum laude, magna pa 
laude, and cum laude); d of birth of student 

rents where гесогаес. А 
ш prone ta at this college differed in some 
respects from students in most other colleges, 
since they attended a free tuition non-residential 
ity of New york. That recent im- 


i this country took advantage of the op- 
mer ах 3 for their children 


portunity for a free education 


* Footnotes will be f 


ound at the end of the article. 


is indicated by the following facts. Of 270stu- 
dents for whom the country ofbirth was recorded, 
42, or 16%, were foreign born. Of 114 students 
entering between 1923 and 1939 when the birthplace 
of the parents was recorded, it was found that both 
the parents of 63, or 55%, were foreign born, one 
of the parents of 20 students, or 18%, was foreign 
born; while 31 students, or 27%, had both parents 
native born. 

Since it seemed desirable to obtain so me indi- 
cation of the way in which the records of the stu- 
dents who subsequently earned the doctorate com- 
pared with records of all the students for the same 
périod, a random sample of 294 of the latter was 
chosen. To offset any changes in grading standards 
over this period of years, the same number of 
individuals was picked from each graduating 
class as was included in the originallist. The re- 
cords were chosen by applying numbers from a list 
of random figures (2) to the numbered alphabetized 
list of graduates for eachsemester. Thedata 
taken from each record incl uded in the random 
sample were limited to the cumulative index, the 
index of the first term, and honors. 


Prospective Doctors Versus the Average Student 


In Figure 1 are shown the distributions of the 
cumulative indices of the undergraduate records of 
the future doctors and of the individuals of the ran- 
dom sample. It is obvious that, whereas the indi- 
ces of the random sample fall into a curve which, 
like most grade curves, is skewed to the right, the 
indices of the doctors fall intoa curve which is 
skewed to the left. The Pearsonianmeasure of 
skewness for the sample is -0, 248 and for the doc- 
tors «0.302.'* The difference of 0.48 between the 
mean of 3.04 + 0.496 for the doctors and 2.56 + 
0.466 for the sample is highly significant with at 
value of 12.3 for 294 cases of each. The probabil- 
ity of this difference being ins ignificant is less 
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FIGURE 1 


DISTRIBUTION OF CUMULATIVE INDICES OF STUDENTS WHO LATER EARNED 
THE DOCTORATE AND OF STUDENTS IN THE RANDOM SAMPLE 
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than 0. 001. mE 
In Figure 2, the distributions ofthe indices for 


the first term in college аге shown for the doctors 
and for the sample. The curves here are plotted 
with intervals of 0.3 in indices instead of 0.2 as 
was used in Figure 1, because, with the wider 
range of the indices of the first term and the ten- 
dency for sets of grades earned ina single se- 
mester to fall into patterns, the interval of 0.3 
was found to give a clearer picture of the distri- 
bution. Here both curves are skewed to the left, 
due to the very low grades of some beginning stu- 
dents, but there are more individuals with indices 
above 3.0 among the doctors than among students 
in the random sample. The differences between 
the mean of 2. 81 + 0.69 for the 294 doctors and 
2.30 + 0. 66 for the sample is 0.51 with a t value 
of 9.0 and the probability of a random occurrance 
less than 0.001. 

To determine the degree of correlation between 
the cumulative indices for the entire undergradu- 
ate period and the first term grades, the coeffi- 


cient of correlation was calculatedfor each group. 


For the sample the coefficient of correlation was 
0.71 with a t value of 17.41, the agreement of the 
two indices having a high significance with aprob- 
ability factor less than 0.001. For the doctors, 
the coefficient of correlation was considerably 
higher, 0.86 with a t value of 29.05 and a proba- 
bility far below 0. 001. * 

The coefficient of correlation was also deter- 
mined for the cumulative indices of the doctors 
and their high school averages where thelatter 
were available. These data are not particularly 
reliable because admission to the college during 
some periods was based on the weighted average 
of high school grades and at other times оп the 
weighted average of the Regents’ Examinations of 
New York State which werehighly variable. Nev- 
ertheless, the coefficient of correlation of the 266 
records included was 0. 66 with a t value of 14. 11 
and a probability of less than 0. 001. 

It is seen therefore, as was expected, that the 
undergraduate grades of students wholater earn- 
ed the doctorate are significantly higher than 
those of the average student, even in £r ades 
earned in the first term and at the high school 
level. The surprising fact, however, 1S theoc- 
currence of low grades at all three levels ofa 
few students who later obtained the doctorate. A- 
mong the 294 students in this Е roup, four were 
dropped for poor scholarship at some time during 
their undergraduate years, and later earned re- 
matriculation by attending courses given in the 

vening session as non | 
TWO а these students obtained the doctorate in 
Education, one in Chemistry and one in Psychol- 


ogy- 


-matriculated students. 


Value of First Term Index аз an Indicator of Aca- 
demic Potential 


There is currently in many colleges an inter- 
est in providing an enriched and stimulating cur- 
riculum for students with potentialities for super- 
ior work and advanced study. To this end, it is 
highly desirable to be able to identify a large ma- 
jority of these students near the beginning of 
their college course. For this the first term 
indices and cumulative indices of the doctor- 
al group were compared to determine with what 
reliance success as lower f reshmen is a predic- 
tor of success in the total college curriculum. 

In Table I is shown a comparison between the 
first term indices and the cumulative indices 
grouped in intervals of 0.5. Of 50 students with a 
first term index of 3.5 or above, 39, or 78%, fin- 
ished with a cumulative index in the same range, 
and the remaining 22% had indices above 3.0. Of 
90 with a first term index between 3.0 and 3.4, 
92% completed their college work with an index of 
atleast 3.0, with only 8% in the group below 3.0. 
Of 89 students with a first term index below 2.5, 
only two reached a 3. 0 cumulative index. 

In Table II is a similar comparison of the first 
term indices and cumulative indices ofthe random 
sample. The lower academic success of the 294 
persons composing the random sample as con- 
trasted with the similar number shown in Table I 
is apparent. И, however, we examine the most 
superior among the random sample, it is evident 
that the conclusions reached above hold. Fiveof 
nine students with a first term index above 3. 5 had 
a cumulative index above 3.5, and the four others 
had cumulative indices above 3.0; of those having 
a first term index of 3. 0 to3.4, 27 (66%) complet- 
ed their undergraduate work with an index above 
3.0. 

The outcome of this survey indicates that su- 
perior students in almost all cases aresuperior 
in their first term, especially inthe more out- 
standing group, and a selection of students with a 
first term index of 3.5 or above would yield а 
group with a high percentage of prospective worth 
as doctoral candidates. 


Comparison of Grades of the Doctoral Group in 
Different Fields 


For a comparison of the grades of the doctoral 
group in the different divisions of 5 ubjects, the 
undergraduate records were separated into the 
main fields in which the different disciplines were 
grouped in the report by the Office of Scientific 
Personnel.? Included within the physical sciences 
are chemistry, geology, mathematics and physics; 
within the biological sciences, biology, biochem- 
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TABLE I 


COMPARISON OF FIRST TERM INDICES AND CUMULATIVE INDICES OF 


294 STUDENTS WHO LATER EARNED THE DOC TORATE 
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-Cumulative Indices 


First Term Indices 


1.6-1.9 


2.0-2.4 


2.5-2.9 


3.0-3.4 


3.5-3.9 


Cumulative Indices 


1.6-1.9 
2.0-2.4 
2.5-2.9 


3.0-3.4 


0.4-0.9 1.0-1.4 1.5-1.9 2.0-2.4 2.5-2.9 3.0-3.4 3.5-4.0 
0 1 1 2 0 0 0 
1 11 13 13 5 0 0 
0 0 12 33 31 7 0 
0 0 0 2 28 64 11 
0 0 0 0 1 19 39 

TABLE II 
COMPARISON OF FIRST TERM INDICES AND CUMULATIVE INDICES OF 
294 STUDENTS IN THE RANDOM SAMPLE 
First Term Indices 

0.4-0.9 1.0-1.4 1.5-1.9 2.0-2.4 2.5-2.9 3.0-3.4 3.5-4.0 
i 8 12 4 2 0 0 
4 17 39 50 10 0 0 
0 1 11 23 45 14 0 
0 0 1 1 15 21 4 
0 о 0 0 0 6 5 


3.5-3.9 
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istry, biophysics, physiology, pharmacology and 
premedical work; within the arts and humanities, 
fine and applied arts, business, classical lan- 
guages andliterature, English and American lit- 
erature, humanities, home economics, library and 
archival sciences, law and jurisprudence, linguis- 
tics, modern foreign languages andliterature, 
music, philosophy and speech; within the social 
Sciences, anthropology, archeology, economics, 
geography, history, political science and sociol- 
ogy. Psychology and Education were treated as 
separate fields. 

In Table III, the average cumulative index for 
the students in each of these fields is given in the 
second column. With the exception of Education, 
the differences between the groups are small. By 
computing the estimated variance (1) of these 
groups, we obtain an F value of 1.3, with a prob- 
ability greater than 0.10, indic ating that these 
differences are not significant. 

The average for those who obtained the doctor- 
ate in Educations, however, differed widely from 
the averages of all the other groups. The curves 
of distribution of the indices for these two groups 
have been plotted in Figure 3, along with the 
curve for the random Sample. The curve for the 
doctors in Education is bimodal; the mode of the 
majority, 2.4, coincides with the mode of the 
random sample, and the mode of the minorty, 
3.4, coincides with the mode of the non-educa- 
tion doctors. The difference of 0.47 between the 
means of the education and non-education groups 
is highly significant with a t value of 7.1 and a 
probability less than 0. 001. The difference of 
0.15 between the mean of thesample and the mean 
of the education group is barely Significant with 
а t value of 2.0 and а probability of 0.05. Тће 
distribution of indices in all other fields fell into 
curves similar to that of the non-education group. 

The explanation of the bimodal curve in the ed- 
ucation group can only be Surmised. It cannot be 
explained by the assumption that superior Stu- 
dents obtained the degree soon after graduation, 
while mediocre students teaching at the second- 
ary or elementary level started graduate work 
later or took more time to complete it, since the 
average index was 2.63 for 13 obtaining th e de- 
gree within ten years, 2.68 for 40 persons taking 
between 11 and 20 years, and 2.70 for 11 taking 
between 21 and 33 years. 

Although there are no si gnificant differences 
between the average indices of the fields » With 
the exception of Education, the picture is some. 
what different when the averages of separate Sub- 
jects are compared. In Table IV are listed the 
average indices of all Subjects, except Educ 
in which there were three or more individ 
The means vary from 3.61 for Mathema 
2.81 for Sociology. By computing the est 
variance for these groups, we get an F value of 
1.91, with a probability less than 0.05, In the 
fields defined above, such widely di vergent sup. 


ation, 
uals, 
tics to 
imated 


jects as Mathematics andGeology areboth group- 
ed together in the field of physical sciences,a 
fact which tends to obscure the differences be- 
tween the subjects. 


Comparison of Cumulative Indices Versus Indices 
Obtained in Field of Doctorate 


In order to determine to what extent special a- 
bilities in particular subjects may be obscured by 
the application of the cumulative index to cover all 
undergraduate work, the indices earned in the sub- 
ject of the doctorate were determined, or in the 
major if related to the doctorate; i.e., in an un- 
dergraduate Chemistry major for a person obtain- 
ing the doctorate in Biochemistry. Whenever less 
than six credits were taken in the subject of the 
doctorate, individuals (29) were omitted from this 
Study. In the third and fourth columns in Table Ш 
are shown the number of students in each field and 
the average index in the doctoral subject, and in 
the last column are given the differences between 
the cumulative index andthe index in the subject of 
the doctorate. The index in all cases in the field 
of Education is 
ation has never 


t ) 1 Тће ауегаре 1пдех 
in their various undergraduate m ajor for those 


who earned a doctorate in Education is 2.79. 

In most cases the average in the subject of the 
S higher than theav- 
includes the ma jor. 


ller differences be- 


ces and arts and humanities, 0.39 and 
0.37 respectively, 


Distribution of Honors 
M of Honors 


The differences i 
Ove are reflected 


» Of course, on the basis of 
ces. Table V shows for each fiel 


lor and Senior 


ducation ar 
the random 
seen in Figure 3, 


above in the Physical sciences, is listed separately 


TABLE III 


COMPARISON OF THE AVERAGE UNDERGRADUATE CUMULATIVE INDICES AND THE 
AVERAGE UNDERGRADUATE INDICES IN THE SUBJECT OF THE 
DOCTORATE IN DIFFERENT FIELDS 


Field Number of Average Cumula- Number of Average Index in Difference 
Individuals tive Index Individuals Doctoral Subject between indices 

Physical Sciences 37 3.26 37 3. 48 .22 
Arts and Humanities 74 3.17 73 3. 54 .37 
Biological Sciences 93 3.11 52 3.55 .24 
Psychology 33 3.07 21 3.51 .44 
Social Sciences 33 3.06 30 3.45 .39 
Education 64 2.71 52 2.99 .28 
Non-Education 230 3.18 213 3.47 .29 

Тога] 294 3.04 265 3.37 .33 


Я5УНО 
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Percentage of Individuals 


FIGURE 3 


DISTRIBUTION OF THE CUMULATIVE INDICES OF STUDENTS WHO LATER EARNED THE DOC TORATE IN 
EDUCATION, OF STUDENTS WHO ЕАВМЕГ THE DOCTORATE IN SUBJEC TS OTHER THAN EDUCATION 
AND OF STUDENTS IN THE RANDOM SAMPLE 


i6 18 20 22 24 26 28 80 232 34 36 38 4.0 
Cumulative Indices 
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TABLE IV 


COMPARISON OF THE AVERAGE CUMULATIVE INDICES FOR EACH 
SUBJECT IN WHICH THERE WERE THREE OR MORE 
STUDENTS WHO EARNED THE DOCTORATE 


Subject 


Mathematics 

Classical Languages 
Anthropology 

Law and Jurisprudence 

Physics 

Biochemistry 

English and American Literature 


History 


Modern Foreign Languages and Literature 
Chemistry 

Biology 

Psychology 

Economics 

Philosophy 

Physiology 

Geology 


Sociology 


Number in Group 


Average Cumulative Index 


3.61 
3.47 
3.28 
3.25 
3.23 
3.18 
3.16 
3.15 
3.11 
3.09 
3.02 
3.02 
3.00 
3.00 
2.95 
2.83 


2.81 


Analysis of variance gives 


a value for Е of 1. 91 and for P of less than .05. 


5 


TABLE У 


DISTRIBUTION OF UNDERGRADUATE HONORS AMONG THE STUDENTS IN 


THE DIFFERENT FIELDS IN WHICH DOC TORATES WERE EARNED 


Field 


Physical Sciences 
Arts and Humanities 
Biological Sciences 
Psychology 

Social Sciences 
Education 

Total 

Non - Education 
Sample 


Mathematics 


Number 
in Group 


294 


Phi Beta Kappa 


Graduation Honors 


13 


15 


45 


44 


Junior Senior Total % of Summa cum Magna cum Cum Total % of 
group laude laude laude group 
8 21 51% 3 7 10 20 54% 
16 31 42% 3 11 24 38 51% 
11 20 38% 1 4 17 22 42% 
10 12 36% 2 2 7 11 33% 
6 11 33% 2 1 8 11 33% 
4 5 8% 0 0 11 11 17% 
55 100 34% 11 25 ТІ 113 39% 
51 95 41% 11 25 66 102 44% 
20 25 9% 1 4 25 30 10% 
0 7 88% 3 4 0 т 88% 
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because of the outstanding record of seven high 
awards in each category conferred within a group 
of only eight undergraduates. 


Male Versus Female Students 


Of the 13 male students included in this study, 
12 admitted in 1946 or thereafter graduated in 
1949 or 1950, and so had obtained the doctorate 
by 1956 when this study ends, ina maximum of 
six or seven years. Their cumulative indices 
ranged from 3.3 to 3.7, with an average of 3.4. 
Only three women of those graduating in 1949 or 
1950 had earned the doctorate by 1956, with indi- 
vidual indices of 2.8, 2.9 and 3. 9 and an average 
of 3.2. During this period there were 357 male 
graduates as compared with а total of 2,358 fe- 
male graduates, a ratio of one to 6. 61. Thus the 
ratio of graduates earning the doctorate within 
six or seven years was approximately 26.4 men 
to one woman. This suggests that qualified wo- 
men, due to marriage and their different role in 
Society, tend to delay the pursuit of a doctorate 
or do not undertake it at all. 


Discussion 


The first objective of this study of the records 
of undergraduates from a single college wholater 
earned a doctoral degree was to dete rmine the 
quality of these students as compared with a ran- 
dom sample of the student body. The latter sam- 
ple was composed of the same number of individ- 
uals for each class, selected randomly as des- 
cribed above, as the classes had contributed to 
the doctoral group. The results show that the av- 
erage of the undergraduate records of the doctor- 
al group is considerably higher than the average 
of the random sample with a difference (0.48) that 
is definitely significant (P<0.001). The distribu- 
tion of the grades of the doctoral group is repre- 
sented by a curve skewed to the left while the 
curve of the random sample is skewed to the right 
шк of the indices of the first term 
of the two groups presents a similar picture (Fig- 
ure 2). In the latter chart, the tails in each case 
extend farther to the left than in Figure 1 because 
lower averages may occur inthe first term than 
are permissible for graduation, but the means of 
the two curves differ by a decidedly significant 
amount, the future doctors ea rning an average 
index higher by 0. 51 (P« 0.001). The correlation 
of the first term indices of the docto ralgroup 
with their cumulative indices is Very high (0. 86) 
and appreciably greater than the high correlation 
value for these two sets of indices for the random 
sample (0.71), indicating a greater degree of 
consistency in the records of the superior group. 

The second objective was to determine whether 
the undergraduate records of students who later 


Obtained the doctorate showed any significant dif- 
ferences as related to the particular disciplines 
in which they obtained the doctorate. When the 
records were separated into the six fields desig- 
nated in the report of the Office of Scientific Per- 
sonnel, no significant difference was noted except 
in the field of Education. When the individual dis- 
ciplines were arranged separately in order of des- 
cending indices, significant differences were ap- 
parent between the extremes of the list. The 
groupings of subjects by the method of the Office 
of Scientific Personnel had obscured these differ- 
ences, e.g., both Mathematics and Geology are 
included in the field of the Physical Sciences, but 
the average of students in Mathematics differs ap- 
preciably from that of students in Geology. 

The average of the cumulative indices of stu- 
dents who later obtained a doctorate in E d ucation 
differs from that of the non- education group by an 
amount which is definitely significant (average in- 
dices less by 0.47, with P« 0.001.) The distri- 
bution of the indices for the education group is 
represented by a bimodal curve (Figure 3) with 
one mode, of a smaller proportion, coinciding 
with the mode of the non-education group, anda 
Second mode, composed of themajority, coincid- 
ing with the mode of the random sample. Webb 
(4) has found a similar difference among candi- 
dates for the Master's degree at Emory Universi- 
ty. He reports that non-education students had 
better undergraduate records and made higher 
Scores on all of a series of tests than did Educa- 
tion students. 

Finally it was deemed advisable to consider 
these results for any criteria which might be ap- 
plicable to the selection of students who possess 
the potential for advanced graduate work. Under- 
graduate records are, of necessity, the only indi- 
cator here. Relative attainments within the Grad- 
uate School have not been considered and the e- 
ventual awarding of the Doctor's degree Ваз been 
accepted as a single criterion of success in grad- 
uate work. Some studies have approached the 
problem of undergraduate-graduate correlation 
from the point of view of ratings within the Grad- 
uate School. Webb (5) studied graduate students 
at Emory University, coming from agreat variety 
of undergraduate institutions. He examined the 
relative merits of 1) undergraduate t rans cripts, 
2) the Cooperative English Test, 3) the Coopera- 
tive General Culture Test, and 4) evaluation by the 
faculty of the Graduate School. The high value of 
the undergraduate transcripts is evident from his 
studies, even though his analysis dealt with under- 
graduates coming from numerous colleges of un- 
like standards. The undergraduate records ex- 
amined for this data have been earned in asingle 
institution where faculty appraisal and ratings are 
probably more homogeneous. 

In this survey there is evidence that the cumu- 
lative index and even the first term index may be 


60 JOURNAL OF EXPERIMENTAL EDUCATION 


highly useful as a predictor of degree attainment 
in Graduate School. Approximately all students 
who have an index of 3.5 or more in the first 
term have the potential for high ac ademic a- 
chievement, and those with a first term average 
of 3.0 to 3.4 include a large percentage who are 
qualified for graduate study. It would appear 
therefore to be highly advantageous to encourage 
students in these categories to consider graduate 
study and to adopt a curriculum in college that 
will provide better than average stimuli. 


Conclusions 


The undergraduate records of 294 students 
from one college who subsequently earned the 
doctorate were significantly better than thoseof 
a comparable random sample from the same 
classes, both for the first term and for the cum- 
ulative average of all their college work. 

The correlation between first term grades and 
the cumulative average is high for both groups, 
with a coefficient of 0.86 for the doctors and 0.71 
for the random sample. Thereisalso significant 
correlation between high school and college aver- 
ages for the future doctors with a coefficient of 
0.66. 

A few students with very poor averages earned 
the doctorate, including four who had been drop- 
ped for poor scholarship and were later reinstat- 
ed. 

Superior students are in almost all cases su- 
perior in their first term. Seventy-eight percent 
of the doctoral group with a first term index of 
3.5 completed their college work witha 3.5 index 
and 92% with a first term index of 3.0 or above 
completed their work with an index equally high. 

There is no significantdifference between the 
college averages of the different fields as defined 
by the Office of Scientific Personnel, except for 
Education, in which the average was considerab- 
ly below that of the other groups with a highly 
significant difference. The distribution of the 
undergraduate grades of the Education group fall 
into a bimodal curve with two modes, one for a 
larger group the same as that of the random 
sample and a second mode for a sm aller group 
the same as that of the other doctors. 

The grade averages when grouped according 
to subjects (rather than fields), with the omis- 
sion of Education, range from a high of 3. 61 for 
Mathematics to a low of 2.81. Analysis of vari- 
ance indicates that these differences are signif- 
icant. 

The averages of the grades earned inthe sub- 
ject of the future doctorate or a related major 
are somewhat higher than those of the general 


average, a tendency which is more marked in the 
social sciences and the arts and humanities than 
in the physical sciences andthe biological scien- 
ces. 
The distribution of honors parallels the differ- 
ences in averages inthe different groups, with 
honors in Education fewer and comparable to the 
those in the random sample. 

For graduates during 1949-50 when both 
male and female students received degrees, the 
number of male students obtaining the doctorate 
by 1956 was far in excess of the number of female 
students with a ratio of 1 to 26.4 when pro-rated 
for numbers of male and female graduates. 


FOOTNOTES 


1. Skewness of doctors as measured for f, was 
found to be 0. 125 and skewness of sample was 
0.216. For М = 300 both are beyond the 0. 02 
point. The skewness of each is, the refore, 
significant. 

2. There is a factor of dependence involved in 
these correlations since the first term grades 
are included in the cumulative index, but the 
values are sufficiently high notto abrogate the 
correlation. 

3. Data did not indicate exact deg ree earned, i. 
e., Ph.D. or Ed.D. 
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SYLLOGISTIC REASONING 


GEORGE N. BEAUMARIAGE, Jr. 
Sacramento State College 
Sacramento, California 


REASONING HAS been considered as one of 
the factors of intelligence by many psychologists. 
Reasoning in most intelligence tests includes the 
induction of a rule from several instances and 
the drawing of conclusions from syllogisms. At 
times the induction of a rule may appear to be a 
type of matching and recognition of absurdities. 
Certain types of reasoning ability are directed 
toward, and are measured in achievement tests, 
as for example, understanding. This understand- 
ing factor seems to be in reality a type of reason- 
ing ability. Some concept formation tests really 
measure the ability to choose the answer toa 


problem. | | 
In the past, measureme nts of intelligence 


were more preoccupied withthe ability necessary 
to apply formal logic. The English still seem to 
demand an ability to handle formal logic as a 
measure of ‘‘intelligence. '' Actually, inone of 
our more modern tests of mental maturity and 
ability, the California Mental Maturity Test, 
formal logic is found in only one-seventh of the 
est. 

‘ The problem of language has great importance 
when one considers logic as a measure of reason- 
ing ability. If the test problem measuring logic 
involves the ability to understand written language, 
the logic might be obscured by the language abil- 
i e. 

ч Е poses of this paper, syllogistic 
reasoning will be that ability necessary арі log- 
ically determine the corre ct conclusion = а, 
group of facts presented in the form of a syllo- 
gism. 

The particular form 0 
logistic reasoning, and wi | 
ШЕ of the subject’s ability to do deductive зат 
ing. Inductive reasoning will not be considered. 

To determine the syllogistic reasoning abil- 
ities of the subjects, the following syllogisms 
were used: Those that are found in Part 4 of the 
California Short Form Test of Mental Maturity, 
Elementary 1950 S Form; and Sir Cyril Burt s 
Test No. 29, Graded Reasoning Test, Short List 
(2). Some changes in the language of the Burt 
list have been made to conform with American 


f logic used will be syl- 
ll, in effect, be a meas- 


usage since this test was originally designed for 
English usage. A copy of the Graded Reasoning 
Tests (Short List) is included in the Appendix. 

Some fifty-three pupils were given the Califor- 
nia Mental Maturity Test and the Graded Reason- 
ing Test, Short List, by Sir Cyril Burt. The In- 
ference Test from the California Mental Maturity 
Test was then compared to the Graded Reasoning 
Test. 


The Procedure 


The California Mental Maturity Test is a group 
test. The writer administered this test to four 
groups of children composed of 4th, 5th, and 6th 
graders. 

Approximately one and one-half hours were 
spent in administering each of these tests. The 
results from the testing of fifteen 4th graders are 
summarized in Table I, of fourteen 5th graders 
in Table II, and of twenty-four 6th graders in Ta- 
меш. It isto be noted that these tables record 
the mental age score in months. The test itself 
is made u p of spatial relationships, two parts of 
logic reasoning, two parts of numerical reasoning, 
and two parts of verbal conceptions according to 
the titles given. For the purposes of this paper 
the results from Test Four, Inferences, are re- 
corded. This Test consists of fift een situations 
that require logical application of deductive rea- 
soning for solution. Thetest results, in terms 
of mental age in months, forthis test are found in 
Column 5 of the tables. 

Sir Cyril Burt's Test 29, Graded Reasoning 
Test, Short List, consists of some seventeen 
items. Startingat a base level of six and one-half 
years equal to 0 and counting each test correctly 
solved and ex plained as one-half year, the test 
goes to 15 years. Theoretically, a child with an 
IQ of 100, or average, will correctly answer all 
of the questions listed beneath his age. Each test 
is equivalent of one-half year with 0 falling at six 
and one-half. 

This test requires individual examination. The 
child is required to read the question and may be 
helped with any andalllanguage difficulties, until 


TABLE I 


FOURTH GRADE 
Mental Age in Months 


1 2 3 4 5 6 7 8 9 10 11 
Logical Numer- Non- 

Spatial Reasoning ical Rea- Verbal Lan- Lan- Total B 
Child CA Relations Syl. Inf. soning Concepts guage guage Mental Syl. 
1 121 119 132 94 133 120 110 126 116 96 

2 131 134 176 168 120 118 126 134 132 156 

3 121 134 107 131 133 108 114 123 119 138 
4 121 123 155 179 141 134 141 126 135 156 

5 123 102 155 101 95 0 0 107 92 102 
6 119 158 155 108 132 126 117 150 132 102 
7 117 84 132 109 120 108 103 96 102 114 
8 133 84 97 180 120 123 127 90 121 162 
9 120 120 131 92 130 2 10 122 90 102 
10 132 132 170 160 122 118 124 119 121 144 
11 118 115 110 130 132 122 118 120 119 138 
12 119 131 150 160 138 116 128 130 130 162 
13 123 87 148 110 100 130 105 103 104 102 
14 122 96 146 120 128 108 110 108 110 108 


15 134 86 100 115 115 120 108 110 109 96 
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TABLE II 


FIFTH GRADE 
Mental Age in Months 


1 2 3 4 5 6 y 8 9 10 11 
Logical Numer- Non- 

Spatial Reasoning ical Rea- Verbal Lan- Lan- Total B 
Child CA Relations Syl. Inf. soning Concepts guage guage Mental Syl. 
1 131 123 114 114 96 128 113 118 117 117 
2 138 108 175 108 120 125 118 112 116 102 
3 136 177 156 122 134 118 101 158 120 114 
4 133 195 174 188 102 135 135 162 148 159 
5 127 141 156 130 159 135 134 156 142 126 
6 125 127 176 130 134 143 136 142 138 132 
7 131 168 176 180 166 169 168 167 168 144 
8 129 168 174 156 166 142 144 168 150 150 
9 138 196 197 174 182 167 170 192 179 156 
10 137 178 174 169 166 155 160 162 160 162 
11 132 168 155 197 166 166 169 165 168 168 
12 138 143 156 122 146 142 140 139 141 108 
13 134 155 174 177 155 159 159 158 158 162 
14 135 177 175 197 177 166 173 174 175 176 
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TABLE III 
SIXTH GRADE 
Mental Age in Months 
1 2 3 4 5 6 7 8 9 10 11 
Logical Numer- Non- 
Spatial Reasoning ical Rea- Verbal Lan- Lan- Total B 
Child CA Relations Syl. Inf. Soning Concepts  guage guage Mental Syl. 
1 143 176 154 178 147 116 132 160 140 168 
2 135 148 156 121 139 152 141 148 144 114 
3 157 169 174 17 159 151 156 167 158 174 
4 147 176 174 169 158 152 158 162 158 162 
5 145 195 174 168 140 146 146 174 153 132 
6 147 105 175 186 180 149 165 123 149 176 
7 144 107 174 114 159 144 143 114 133 103 
8 136 186 156 157 184 146 153 181 165 162 
9 145 154 106 114 148 122 116 145 128 102 
10 138 140 132 132 172 148 148 139 147 126 
11 151 186 115 121 141 112 115 194 136 126 
12 140 104 155 123 173 131 138 116 130 114 
13 168 186 174 157 160 156 156 164 157 144 
14 152 96 177 102 125 132 118 108 114 96 
15 145 185 155 143 167 157 155 166 157 150 
16 146 98 174 132 156 137 143 108 128 132 
17 146 128 174 120 126 160 137 138 138 114 
18 143 160 156 144 134 144 144 140 156 138 
19 156 123 156 131 158 139 140 132 138 132 
20 149 196 174 144 114 148 134 175 148 132 
21 156 140 174 108 113 151 133 142 138 114 
22 143 124 114 156 134 150 150 114 138 144 
23 165 156 132 127 127 128 144 144 188 126 
24 150 134 


174 168 140 109 128 132 131 162 


FOURTH-GRADE TEST SCORE COMPARISONS 


TABLE IV 


1 2 3 4 5 6 

Rank Order B Rank Order 

C. A. Inference Total Mental Total Mental Syllogisms Syllogisms 
133 180 121 4 162 1 
121 179 135 1 156 2 
131 168 132 2 156 2 
132 160 121 4 144 3 
119 160 130 3 162 1 
121 131 119 5 138 4 
118 130 119 5 138 4 
122 120 110 Т 108 6 
135 115 109 8 96 8 
123 110 104 9 102 7 
117 109 102 10 114 5 
119 108 132 2 102 7 
123 101 92 11 102 1 
121 94 116 6 96 8 
120 92 90 12 102 7 
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TABLE V 


FIFTH-GRADE TEST SCORE COMPARISONS 


1 2 3 4 5 6 

Rank Order B RankOrder 

C. А. Inference Total Mental Total Mental Syllogisms Syllogisms 
135 197 175 2 176 1 
132 197 162 3 168 2 
133 188 148 7 159 4 
131 180 168 3 144 1 
134 177 158 5 162 3 
138 174 179 1 156 5 
137 169 160 4 162 3 
129 156 150 6 150 6 
127 130 142 8 126 9 
125 130 138 10 132 3 
138 122 141 9 108 12 
136 122 120 11 114 11 
131 114 117 12 117 10 


138 108 116 13 102 15 
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TABLE VI 


SIXTH-GRADE TEST SCORE COMPARISONS 


1 2 3 4 5 6 
Rank Order B RankOrder 

C. A. Inference Total Mental Total Mental Syllogisms Syllogisms 
175 186 149 6 176 1 
143 178 140 9 168 3 
157 177 158 2 174 2 
147 169 158 2 162 4 
145 168 153 5 132 8 
150 168 131 13 162 4 
136 157 165 1 162 4 
168 157 157 3 144 6 
143 156 138 10 144 6 
149 144 148 7 132 8 
143 144 156 4 138 7 
145 143 157 3 150 5 
138 132 . 147 8 126 9 
165 132 138 10 126 9 
146 132 128 15 132 8 
156 131 138 10 132 8 
140 123 130 14 114 10 
135 121 144 8 114 10 
151 121 136 11 126 9 
146 120 138 10 114 10 
145 114 128 15 102 11 
144 114 133 12 102 11 
156 108 138 10 114 10 


159 102 114 16 96 12 
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the tester is assuredof his success with the lan- 
guage of the question. The subject may read si- 
lently if he desires and the tester finds that he 
can successfully handle the material. 

After the child understands the task, he is al- 
lowed to think it through. Then he must answer 
the problem. After he has answered the problem, 
he is givenascoreof one. He must then give his 
reasons for the answer. Ifhis reasoning is faulty, 
then one-fourth score is deducted for each faulty 
reason. Ifthe child gives an incorrect answer to 
the problem, he is asked to try again. After four 
unsuccessful attempts, he continues to the next 
problem. After three consecutive problems are 
missed four times each, the test is finished. A 
correct answer may be cancelled as far as scor- 
ing is concerned by incorrect reasoning. Мон - 
vation, approval, and other practices conducive 
to good rapport between the tester and subject 
should be practiced. 

The writer had each of these seventeen items 
on a card and gave the cards to the child for him 
to read. It was necessary to change some words 
from the original test so that they would more 
nearly resemble those in common usage in this 
country. For instance, the word ‘‘cleverer’’ was 
changed to ‘‘smarter’’, because the children had 
difficulty with ‘‘cleverer.’’? The word ''blouse" 
was changed to ‘‘shirt,’’ ‘‘ walking stick” to ‘сапе? 
and “сгіскей” to “Бай.” Locations such as 
France, the Scottish Hills, and sea coast were 
changed to Hawaii, Sierras, and Beach. Some 
other words that could have given difficulty were 
not changed because no difficulty was actually in- 
curred. The resultsof this test are found in Col- 
umn II in Tables I, II, and III. 

According to Sir Cyril Burt, the efficient test 
for measurement of mental abilities is one that 
requires logical inference for solution. When the 
testing situation gives all of the facts required 
for the solution, thus eliminating special knowl- 
edge, empirically that test is the best measure 
of intelligence available. 


Conclusions and Implications 


Some fifty-three children were given both the 
California Mental Maturity Test and the Graded 
Reasoning Test (Short List). Fifteen fourth grad- 
ers were tested, fourteen fifth graders, and 
twenty-four sixth graders. 

The test results are found in Tables I, II, and 
Ш. Tables IV, V, and VI give some of the scores 
most appropriate to this study. It is to be noted 
that these tables are in rank order in terms of 
months of mental age and include chronological 


e. 
42 For the fourth-grade scores, the Spearman 
rank difference correlation, rho, betweenthe syl- 
logism test and the inference test is 0. 88. 

For the fifth-grade scores, rhois 0. 86 between 
the total and inference scores, and 0.91 between 
the syllogism and inference scores. 

The rank order ofthe scores for the syllogisms 
agrees very well with the rank order of the infer- 
ence scores from the Mental Maturity Test. How- 
ever, the total mental score from the Mental Ma- 
turity Test does not agree as well. Chronological 
age seems to have even less correlation. 

Since the Mental Maturity Test purports to test 
more than logical reasoning ability, then perhaps 
these factors do not necessarily correlate with 
reasoning abilities. 

Little significant difference was found in the 
ability to handle syllogisms bet ween children of 
grades four and six. The relationship between 
chronological age and ability to think logically 
seems to be determined by some sort of intelli- 
gence, native or otherwise. Actually, those chil- 
dren who, in general, had the highest score in 
terms of mentalage didthe best on the syllogisms. 

Language had an effect on ability to handle the 
syllogisms. Many times the children asked ques- 
tions concerning pronunciation and meaning of 
words. Actually, there seemed to be an unwilling- 
ness totackle any unfamiliar word for fear it would 
be misleading inthe solutionofthe problem. There 
seemed to be a general attempt to hunt for hidden 
meanings, and when the children found out they 
could ask questions they tended to ask more than 
they actually neededto ask. This slowed down the 
process and thus much time was required. 

When the children gave wrong answers or wrong 
reasons for their answers, they then began to 
guess morethan whenthey had success. Guessing 
seemed to increase withfailure. The guessing 
did not exactly reflect illogical reasoning, it more 
nearly reflected no reasoning at all. When cau- 
tioned, the children seemed to use better logic 
than when allowed to proceed without any ге- 
straint. 

A second test equivalent to the Burt test but (0 
be administered as a group test requiring written 
answers might disclose whether the children real- 
ly needed all the information they requested. It is 
felt that the security the children got from the 
ability to ask questions materially aided them ап 
resulted in slightly higher scores. 

In general, there seems little doubt that the 
syllogism will give an indication of the mental abil- 
ity of the subject. However, there is another fac- 
tor (or factors) here—that the writer has 100 few 
data to identify correctly. 
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APPENDIX 


GRADED REASONING TESTS 
(Short List) 


Tom runs faster than Jim; 
Jack runs slower than Jim. 
Which is the slowest of the three? 


7 Years 


Kate is cleverer than May; 
May is cleverer than Jane. 
Who is the cleverest—Jane, Kate, or May? 


Ihave bought the following Christmas presents: a pipe, a blouse, some music, a box of cigarettes, 
a bracelet, a toy engine, a bat, a book, a doll, a walking-stick, and an umbrella. 

My brother is eighteen; he does not smoke, nor play cricket, nor play the piano. 

I want to give the walking-stick to my father, and the umbrella to my mother. 


Which of the above shall I give to my brother? 


8 Years 


I don't like sea voyages; 


And I don't like the seaside. 
Imust spend Easter either in France, or among the 
Scottish Hills, or on the South Coast. 


Which shall it be? 


The person who stole Brown's purse was neither dark, nor tall, nor clean-shaven. 


The only persons 


in the room at the time were— 


1)Jones, who is short, dark, and clean-shaven; 


2) Smith, who is fair, short, and bearded; 
3) Grant, who is dark, tall, but not clean-shaven. 


Who stole Brown's purse? 


10 


10. 


41, 


12. 


13. 
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9 Years 


Three boys are sitting in a row; 
Harry is to the left of Willie; 
George is to the left of Harry. 
Which boy is in the middle? 


In cold, damp climates, root crops, like potatoes and turnips, grow best; 

In temperate climates, there are abundant pastures, and oats and barley flourish; 

In sub-tropical climates, wheat, olives, and vines flourish. 

The ancient Greeks lived largely on bread, with oil instead of butter; they had wine to drink, and 
raisins for fruit. 
Which climate do you think they had? 


10 Years 


There are four roads here: 
I have come from the south and want to go to Melton; 
The road to the right leads somewhere else; 
Straight ahead it leads only to a farm. 
In which direction is Melton—North, South, East, or West? 


The doctor thinks Violet has caught some illness, 
If she has a rash, it is probably chicken pox, measles, or scarlet fever; 


If she has been ailing with a cold or cough, she may develop whoopi 

І E , ping cough easl mps. 

She has been Sneezing and coughing for some days, and now Spots ine арр B Les ase ‘and 
arms. 


What do you think is the matter with Violet? 


11 Years 


Where the climate is hot, gum trees and rubber w: 
Heather and grass will grow only where it is cold; 
Heather and rubber require plenty of moisture; 
Grass and gum trees will grow only in fairly dry regions, 
Near the Amazon River it is very hot and very damp. 
Which of the above grows there? 


ill grow; 


clay onhis boots and flour on his hat. 
› Westgate, or the City; and ће has not 


12 Years 
Ss 


How far am I from the church? 


— ru dia de E honey stored by the bumblebees; the honey which they store is the chief food 
Near towns, there are far more 
Cats kill all kinds of mice. 
Where, then, do you think there are 
open country? 


cats than in the open country. 


the most bumblebees— in the neighborhood of towns or inthe 


14. 


15. 


16. 


TT. 
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13 Years 


А pound of meat should roast for half an hour; 
Two pounds of meat should roast for three-quarters of an hour; 
Three pounds of meat should roast for one hour; : 
Eight pounds of meat should roast for two hours and a half. 
From this can you discover a simple rule by which yo i joi 
[ec AT терген) youcantellfrom the weight of a joint for 


What conclusions can you draw from the following facts? 
Iron nails will not float in a pool; 
А cup of pure gold dust weighs nearly twenty times as much as a cu i 
2 i p of water of the s ; 
ает саар а eat кея ога qr coin into a puddle, it will sink to the = s 
cubic inch (about a tablespoonful) of water weighs less than half an o j ic i 
weighs over two ounces; RENE HUE АЕ brass 
A leaden weight will drop to the bottom of the ocean. 
Sum up all these observations in one short statement of the following form: 
** Most are 2» ` 


14 Years 


John said: “І heard my clock strike yesterday, ten minutes before the first gun fired. I did not 
count the strokes, but I am sure it struck more than once, and I think it struck an odd number." 
John was out all morning from the earliest hours; and his clock stopped at five to five the same af- 


ternoon. 
When do you think the first gun fired? 


Captain Watts and his son James have been found shot—the f i А 
ар. Both clearly died instantaneously. ather B thechest andthe gon imithe 
A gun fired close to the person—as, for example, when a man shoots hi —wi 

even burn the skin or clothes; fired from a greater distance, it will en vnm ori a 

The two bodies were found near the middle of a large hall used as a rifle range. Its floor is cov 
ered with damp sand, which shows every footprint distinctly. Inside the room there are tun 
pairs of footprints only. A third man standing just outside the door or window could aim at a 
part of the room, but the pavement outside would show no footmarks. s 

Under Captain Watts' body was found a gun; no such weapon was found near James. 

In each er the coat, where the bullet entered, was blackened with gunpowder, andthe cloth a little 
singed. 

Captain Watts was devoted to his son, and would have died sooner than harm him purposely; hence 
it is impossible to suppose that he killed him deliberately, even in self-defense. But some think 
that James secretly disliked his father, and hoped to inherit his fortune at his death. 

Was Captain Watts’ death due to murder, accident, or suicide? 
Was James’ death due to murder, accident, or suicide? 
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ANALYSIS OF ADOLESCENTS? RESPONSES 
TO THE F SCALE 


ТАСК В. FRYMIER 
Auburn University 


The Problem 


WILL DIFFERENCES in cultural background 
affect the way adolescents respond to the F scale, 
a measure of anti-democratic . (authoritarian) po- 
tential? Ifthere are differences, will they be ap- 
parent in total F scale scores? Will differences 
also be apparent in individual items of the meas- 
ure? Ifthere are differences, what do they mean? 

Christie and Garcial* compared F scale re- 
sponses of a group of California university stu- 
dents with a college population from a southwest- 
ern city. They reported that the scores from the 
California group were significantly lower and al- 
so that the California group accepted 18 of the 30 
items to a lesser degree than the other group. 
Other studies by Prothro and Melikian? and Cohn 
and Carsch? indicate that persons living in or 
coming from an authoritarian culture tend to score 
higher on the F scale. 


The Procedure 


To answer the questions posed above, the au- 
thor administered the F scale in conjunction with 
other tests4 to 104 students in a large metropoli- 
tan high school in Michigan and a rural consoli- 
dated school in Alabama. For the purposes of 
this study, it was assumed that urban Michigan 
and rural Alabama constituted different cultural 
situations. Eachstudent from the Northern urban 
area was matched with one from the Southe rn 
rural area on the bases of age, sex, and grade in 
School, making 52 pairs in all. The ems of 
the two groups was 16.38 years, and eac PX 
had 22 girls and 30 boys. These students had a 
lived in their particular locale for at least ten 
years and all were Caucasian. In response s 
preliminary questions abo ut frequency of сш 
attendance during а one- month period, the Nort - 
ern group mean was 3. 74 and the Southern group 
mean was 4. 42 times. The Southern rural group 
also had more persons who indicated they watched 
television **very often" while the Northern urban 
group had agreater number who said they watched 


ЖАП footnotes will be found at end of article. 


television ‘‘occasionally. ” 

The responses to the F scale were tabulated in 
two ways. First, total scores were computed ac- 
cording to the directions of Adorno), Next, agree- 
ment or disagreementÓ with the individual items 
was recorded. 

These data were then manipulated statistically 
several ways. First, mean F scale score s and 
standard deviations were determined for each 
group, andthe difference between these mean 
Scores was then compared by use of the “t” test. 
Second, the number inthe Southern ruraland North- 
ern urban groups who agreed and disagreed on 
each item was compared by computing chi square. 
Third, the percent of each group who agreed with 
each item was determined, and the various items 
listed in rank order of agreement for both groups. 
Fourth, these rank orders were compared by in- 
spection. The results of these procedures follow. 


The Results 


The difference between the mean F scale scores 
for the Nort hern urban group (mean of 3. 95) and 
Southern rural group (mean of 5. 05) was statisti- 
cally significant, as shown in Table I. This seems 
to indicate that there is some factor or factors 
which may be responsible for a considerable dif- 
ference between these two groups on this particu- 
lar measure, the Southern rural group apparently 
tending to exhibit more anti-democratic (authori- 
tarian) potential than the Northern urban group. 

Table II shows a comparison of the Southern 
rural and Northern urban groups’ responses to in- 
dividual items" ofthe Е scale by use of chi square. 
Since the difference between the groups is statis- 
tically significant for 19 of the 27 items, this 
would seem to indicate that there is considerable 
difference inthe way in which the members of these 
two cultural groups responded to these particular 
items of the F scale. 

Table III shows the relative rank order for 22 
ofthe 27 items of the F scale for both Northern 
and Southern groups. Sincethis ranking was not 
identical (there was not a perfect correlation for ali 
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TABLE I 


COMPARISON OF MEAN SCORES OF SOUTHERN RURAL AND NORTH- 


ERN URBAN GROUPS ON F SCALE 


Group Mean 5.р. sup 
Northern Urban 3.95 . 620 
8. 66% 
Southern Rural 5.05 . 667 


*Difference is significant at the . 001 level of confidence. 


TABLE II 


COMPARISON OF AGREEMENT AND DISAGREEMENT 


ON INDIVIDUAL ITEMS OF THE F SCALE FOR 


SOUTHERN RURAL AND NORTHERN 
URBAN GROUPS 


Item Number9 Chi Square 
1 . 00 
2 т. 08» 
3 .98 
4 7, 26* 
5 ‚34 
6 10. 80* 
T .96 
8 10. 04* 
9 10. 86* 
10 5. 56* 
11 12. 48% 
12 3. 83 
13 5. 63* 
14 8. 09* 
32 6. 22* 

Т 6. 19% 
18 6. 71% 
16. 12* 
19 1. 46 
20 E 
21 у 
92 13. 28* 
ел 9. 96* 
22. 10* 
21 15. 46* 
5 3.02 
26 7. 96* 
et 17.71% 


*Differences are significant at the . 05 level of confi- 


dence. 


== 
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TABLE III 


APPROXIMATE RANK ORDER OF F SCALE ITEMS FOR SOUTHERN RURAL 
AND NORTHE 
URBAN GROUPS ACCORDING TO PROPORTION OF GROUP WHO AGREED WITH ки 


ЕАСН1ТЕМ 


Item 


Number? Item 


12 


17 


16 


14 


25 


21 


22 


13 


North. Urban 
Agreement 


Obedience and respect for authority are the 


most important virtues children should learn. 


Young people sometimes get rebellious ideas, 
but as they grow up they ought to get over 
them and settle down. 


No weakness or difficulty can hold us back 
if we have enough will power. 


Someday it will probably be shown that as- 
trology can explain a lot of things. 


There is hardly anything lowerthana per- 
son who does not feel a great love, gratitude 
and respect for his parents. 


Science has its place, but there are many 
things that cannever possibly be understood 
by the human mind. 


What youth needs most is strict discipline, 
rugged determination, and the will to work 
and fight for family and country. 


Sex crimes, such as rape and attacks on 
children, deserve more than mere impris- 
onment; such criminals ought to be publicly 
whipped, or worse. 


No sane, normal, decent person could ever 
think of hurting a close friend or relative. 


The wild sex life of the ancient Greeks and 
Romans was tame compared to the goings- 
oninthis country, even in places where 


people might least suspect it. 


If people would talk less and work more, 
everybody would be better off. 


Human nature being what it is, there will al- 
ways be war and conflict. 


What this country needs most, more than 


laws and political programs, isa few tire- 
less, courageous, devoted leaders in whom 


people can put their faith. 


98 


88 


85 


73 


71 


77 


62 


60 


63 


54 


54 


54 


56 


South. Rural 
Agreement 


98 


98 


98 


92 


90 


85 


88 


85 


79 


86 


83 


"I9 


15 


15 
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TABLE III (Continued) 


Item 


North. Urban 
Agreement 


% 


South. Rural 
Agreement 


11 


20 


10 


15 


24 


26 


Nowadays when so many different kinds of 
people move around and mix tog ether so 
much, a person has to protect himself es- 
pecially carefully against catching an infec- 
tion or disease from them. 


When a person has a problem or a worry, it 
is best for him not to think about it, but to 
keep busy with more cheerful things. 


А person who has bad manners, habits, and 
breeding can hardly expect to get along with 
decent people. 


Some people are born with an urge to jump 
from high places. 


Most of our social problems would be solved 
if we could somehow get rid of the immoral, 
crooked, and feeble- minded people. 


An insult to our honor should always be 
punished. 


People canbe divided into two distinct clas- 
ses, the weak and the strong. 


The business man and the manufacturer are 
much more im portant to society than the 
artist and the professor. 


Nobody ever learned anything really impor- 
tant except through suffering. 


50 


42 


52 


35 


44 


35 


23 


15 


19 


71 


15 


62 


69 


54 


58 


52 


52 


46 
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items, this requires some explanation. The au- 
thor observed that although the proportion of the 
two groups who agreed with any particular item 
differed, in general both groups tended to accord 
approximately the same value to most of the var- 
ious items as they related to the whole. That is, 
even though 75% of the Southern rural group agreed 
with item number 13 andonly 56% of the Northern 
urban group agreed, if the percent of agreement 
for all of the various items were given a rank 
order for both groups, both the Southern rural 
and Northern urban groups accorded this particu- 
lar item approximately the same relative position, 
viz., thirteenth. There were some variations in 
this relative rank order between the groups, but 
the general pattern see med to be quite similar. 
For the pur poses of this study, then, it was de- 
cided that if the relative position of a part icular 
item did not vary more than four positions from 
that of the other group, this item was considered 
to have been accorded approximately the same 
value by both groups in the overall hierarchy of 
values whichseemsto be demonstrated by a com- 
plete ranking of all the items. Ж 
Table III, then, might be interpreted as giving 
some general indication ofthe extentto which these 
two groups were similar rather than different, as 
Tables I and II seem to indicate. | 
Differences greaterthan four positions in rank 
order placement were apparent for four of the 2'7 
items. These are shown in Table IV. It should 
be noted that the relative difference in positions 
of item 19 forthe two groups was not greater than 
four. There were only two items (numbers 5 and 
19), however, on which the Southern rural group 
indicated less agreement than the Northern urban 
group, and this exception seemed important. 


Discussion of Results 
Discussion = "n 


Now, what do all these data mean? Tables I 
and II seem to indicate that there are differences 
between the responses ofthesetwo cultural groups 
to the scale. Table III, on the other hand, 
seems to indicate a rather large area of general 
agreement, while certain specific differences are 
illustrated in Table IV. € 

пне conclusions, some conflicting, seem 
possible. The Southern rural group may be more 
authoritarian than the Northern urban group; ог, 
the Southern rural group may be less intelligent 
or more prejudiced and the Northern urban group 
more intelligent and less prejudiced. Many per- 
50158 have pointed out the relationship between F 
scale scores andintelligence and prejudice. Per- 
haps all of these conclusions are warranted. 

Next, there seem to be certain common values 
which are reflected inthe relative amount of 
agreement with the individual items of the meas- 
ure by both the Southern rural and the Northern 
urban groups, with some disagreement on а few 


other values. The author is not certain whether 
this second inference is justifiable or not, and if 
it is, whether it cancels out part or all of the first 
conclusion (i.e., regarding authoritarianism and/ 
or intelligence and/or prejudice). It would seem 
to indicate, however, that the differences between 
these two groups may not be so great as one might 
assume from the statistical results, or else that 
they are of an entirely different nature than might 
otherwise be supposed. 

Afurther observation might be that children 
from this particular Southern setting seem to be 
more reluctant to disagree than the children from 
the Northern area. Or, said another way, their 
pattern of responses seems to be one of ‘‘agreeing 
with" rather than ‘‘differing from" the test as a 
whole. There are at least three other important 
observations one might make from a study of Та- 
bles Ш and IV, however, and these are discussed 
in more detail below. 

First, the general hierarchy of values evident 
upon inspecting the items in desc ending order of 
agreement seems to point out several general, 
though perhaps inconclusive, tendencies. For ex- 
ample, if one examines both ends of the rank or- 
der in Table Ш he gets the impression that these 
young people want and like mature assistance and 
direction, but they also have confidence in them- 
selves and their own potential. Further, they 
seem to feel that people are important—that every- 
body counts. 

Second, the fact that there is considerable dif- 
ference in the extent to which both groups agreed 
with items 18, 23, and 27, (see TableIV), allof 
which are related to social intercourse іп one way 
or another, seems to point up the fact that the 
members of this particular Southern rural group 
may be more distrustful, more afraid, and have 
less faith in other people than the persons from 
the Northern urban area. The statistical differ- 
ences between the groups onthese particular items 
(see Table П) are greater than the differences on 
any of the other items, too. 

Also, items 5 and 19, which were the only two 
with which the rural group indicated less agree- 
ment than the urban group, seem to be related to 
religious tenents or beliefs. That the Southern 
rural grouptended to give less value to these items 
than the Northern urban group may be an indica- 
tion of some rebellion at religion on their part. If 
this is so, it would not be inkeeping with the gen- 
eral pattern whichseems to be apparent, i.e., the 
Southern rural group being more authoritarian. 
As such it would have to be explained some other 
way. 

Third, an analysis of the responses to individ- 
ual items accordingto sex indicates a general pat- 
tern of similarity within each of the two cultural 
groups, with certain exceptions. These excep- 
tions are discussed below. 

Northern urban girls agreed more than North- 


TABLE IV 


F SCALE ITEMS ON WHICH RURAL AND URBAN GROUPS DIFFERED 


North. Urban South. Rural 
Item Agreement Agreement 
Number9 Item 
18 Nowadays more and more people are prying 
into matters that should remain personal 
and private. 62 94 
23 Most people don’t realize how much our 
lives are controlled by plots being hatched 
in secret places. 42 86 
27 Familiarity breeds contempt. 35 15 
5 Every person should have complete faith in 
some supernatural power whose decisions he 
obeys without question. 62 56 
19 Wars and socialtroubles may someday be 
ended by an earthquake or flood that will de- 
stroy the whole world. 44 35 
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ern urban boys on items 3, 5, 14, and 22—those 
concerned with the limited value of science, faith 
in the supernatural, punis hing sex crimes, and 
working more and talking less. On the other hand, 
the boys from this Northern urban area tended to 
agree more thanthegirls from there on items 10, 
11, 13, 16, and 23—those related to punishing in- 
sults, jumping from high places, need for leaders, 
love for parents, and control of our lives by plots. 

Southern rural girls tended to indicate more 
agreement than boys from that area on items 13 
and 16—need for leaders and love for parents. 
The boys from this particular rural area, how- 
ever, agreed moreon items 6, 7, 14, 15, and 20 
—keep busy and don't worry, need for good man- 
ners, punishing sex crimes, people are weak or 
strong, and getting rid of immoral people. 

These differences can probably be accounted 
for, in part at least, bythe experiences, desires, 
and hopes which these students projected into their 
responses. That the A labama girls disagree 
more regarding punishment of ‘‘sex crimes such 
as rape" than their counter parts from the city 
or than the rural boys is one especially interest- 
ing example of this idea. 

One finalquestion seems to be in order: Is the 
F scale valid? Employment ofthe F scale in the 
conventional manner may point up statistical dif- 
ferences which may or may not be significant 
otherwise. If values are related to authoritarian 
potential, and such would seem to be a reasonable 
assumption, and if ranking items in order of 
agreement gives any indication of a hierarchy of 
values, it would appear that one may be able, in 
certain instances, to demonstrate more areas of 
agreement in responses to the F scale than disa- 
greement; more similarities in valuesthan differ- 
ences. Granted, the procedure employed in this 
study was only a rou gh approximation of the ex- 
tent to which these twogroups were similar on 
this matter. It may be that more refined proce- 
dures might be developed or employed in future 
studies. This author feels compelled to express 
certain reservations about the validity ofthe F 
scale as a measure of anti-democratic or aut hor- 
itarian potentialat this point, however. Itis ad- 
mitted that these reserv ations are more vague 
than specific, but there seem to be some incon- 


sistencies involved. 
Suggested Research 


Several interesting problems were raised 
during the course of this study, but the two which 
seemed most significant to this writer were as 
follows: 1) How would persons from a Northern 
rural area and from a Southern urban area re- 
spond to the various items of the F scale? 2) How 
would those persons who work with adolescents 
expect high-school students to agree with the var- 
ious items of the F scale? Stated another way, 


would teachers or prospective teachers ог social 
workers, for example, accurately perceive ado- 
lescents’ values? 


Summary and Conclusions 


Two matched groups of 52 high-school students 
each from urban Michigan and rural Alabama were 
administered the Е scale. The statistical differ- 
ences between the two groupson the F scale mean 
Scores and 19 of the individual item scores were 
significant. Bothgroups, however, tended to rank 
23 of the 27 items in approximately the same rel- 
ative position, as indicated by the proportion of 
each group who agreed with the particular item. 
The four items which were not generally agreed 
upon seemed to indicate that the Southern rural 
group expressed mor e fear and possibly distrust 
of other people than did the Northern urban group. 
Further, there also seemed to be some indication 
of a negative reaction to certain traditional reli- 
gious ideas on the part ofthe Southern rural group. 

The areas of agreement, however, seemed 
greater, and generally pointed up the idea that 
young people from both cultural situations pos- 
sessed genuine concern for their fellow men cou- 
pled with considerable faith in their own ability to 
get things done. They seemed to want and to ex- 
pect counsel and assistance, in return for which 
they were willing to accord a reasonable amount 
of love and respect for their elders. Expressed 
in one word, these adolescents seemed to possess 
that priceless human ingredient —hope. 
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COMPARISON OF ACADEMIC ACHIEVEMENT, 
APTITUDES, AND INTEREST PATTERNS OF 


TWO-YEAR TECHNICAL STUDENTS AND 
FOUR-YEAR DEGREE CANDIDATES 
IN ENGINEERING 


LOUIS M. HERMAN and MARTIN L. ZEIGLER 
The Pennsylvania State University 


THE CURRENT emphasis on engineering as a 
career has helped produce a bumper crop of ap- 
plicants for college training in this area. Since 
the available colleges and universities can handle 
only a portion of those applying for admission, the 
problem of proper selection and placement of po- 
tential students has become acute. The overall 
field of engineering is in need of both fully trained 
engineers prepared to handle complex probl ems 
and of technicians prepared to serve as engineer- 
77 the demands for this dual level of 
training, the Pennsylvania State Un i versity con- 
ducts a four-year engineering curr iculum at its 
main campus and also a two-year technical pro- 
gram at its various centers. The study reported 
in this paper is an evaluation of the academic a- 
chievements, aptitudes, and interests of students 
within these four- and two-year curriculums. The 
two purposes of the study are 1) to gain informa- 
tion useful for proper selection and curr ic ul um 
placement of students interested in engineering 
and 2) to determine the usefulness of a dual pro- 


gram in engineering. 
Subjects and Procedure 


Seven hundred and fifty-three freshmen enrol- 
led in the four-year program at the C oll ege of 
Engineering and Architecture at the main epa 
in the fall of 1956, and 416 freshmen enrolle in 
the two-year technical program in engineering at 
the college centers during that same period end 
prised the two main curriculum groups studied. 
These numbers represent all students who com- 
pleted their first semester. (In the remainder of 
the report, the four-year engineering program 
will be referred to as curriculum 1, and the two- 
year technical program as curriculum 2). Mem- 
bers of curriculum 1 and curriculum 2 were cat- 
egorized into three subgroups called high achiev- 
ieee MM AMNEM. LLL 
*Footnotes will be found at the end of the article. 


ers, low achievers, and withdrawals, according 
to the following criteria: 

1. High achievers--those remaining in their 
curriculum beyond theirfirst semester and main- 
taining a grade point average of two or better. ! * 

2. Low achievers--those remaining in their 
curriculum beyond their first semester, but fall - 
ingbelow a grade point average of two. 

3. Withdrawals-- those who withdrew from 
their curriculum before their second semester 
began. 

Aptitudes of the various subgroups were com- 
pared, using the Pennsylvania State University 
Academic Aptitude Examination (2). Subtests 
compared on this examination were the arithme- 
tic and algebra sections and а four-part total con- 
sisting of a summation of scores on these two 
previous sections plus scores on the vocabulary 
and paragraph reading sections. 

Interests of the various subgroups were com- 
pared with 24 occupations or groups of occupa- 
tions on the Strong Vocational Interest Blank for 
Men.? Both the ability test and the interest test 
were administered when the students first enrol- 
led at the university, before any course work was 
undertaken. 


Results and Discussion 


Achievements. Thenumerical and percentage 
breakdown of students in the two curriculum 
groups into the three subgroups is shown in Table 
l. The overall chi-square value of 22.67 for dif- 
ferences in distribution of students among the 
subgroups of the curriculums was significant at 
better than the . 001 level. The percentage dif- 
ference between curriculum 1 high achievers and 
curriculum 2 high achievers was not significant 
(СЕ = 1.23, p< .20). There were, though, а 
Significantly greater percentage of low achievers 
in curriculum 2 than in curriculum 1 (CR - 2.39, 


TABLEI 


THE NUMBER AND PERCENTAGE OF HIGH ACHIEVERS, LOW ACHIEVERS, 
AND WITHDRAWALS IN CURRICULUM 1 AND IN CURRICULUM 2 


Group High Achievers Low Achievers Withdrawals 
Number Percent Number Percent Number Percent 
Curriculum 1 394 52.3 210 27.9 149 19.8 
Curriculum 2 233 56.0 144 34.6 39 9.4 


28 


NOLLVOnGS3 IV.INSATDINdX AO тумчпог 


HERMAN - ZEIGLER 83 


p <.02), but a significantly gre ater percent of 
Withdrawals in curriculum 1 than in curriculum 
2 (CR = 4.24, р <.001). Apparently then, the 
percentage of clear-cut success inboth groups is 
about equal, but students in curriculum 1 tend to 
drop out of the program to a greater degree than 
students in curriculum 2. The greater percent- 
age of students remaining in curriculum 2 prob- 
ably accounts for the greater percentage of low 
achievers in this group than in curriculum 1. 

Aptitudes. Table П compares the mean scores 
obtained on the aptitude subtests by the various 
subgroups. It is seen that in every case curric- 
ulum 1 subgroups achieved higher mean scores 
than the corresponding curriculum 2 subgroups. 
Since there were nine comparisons, the probabil- 
ity of such an event occurring by chance is (1 /2) 
orless than .002. It is also seen that the lower 
mean score obtained by any curriculum 1 sub- 
group exceeds the highest mean score obtained 
by any curriculum 2subgroup. Clearly then, 
curriculum 1 students manifest greater abilities 
as measured by these tests than do curriculum 2 
students. 

Comparisons of scores on the four-part total 
of the aptitude test were made within sub groups 
of curriculum 1 and within subgroups of curricu- 
lum 2. For curriculum 1, an analysis of varai - 
ance showed an overall significant difference be- 
tween subgroups (F=25.77, р<.001). 
Subsequent critical ratio tests for significance of 
differences between any two 8 ubgroups showed 
that the high achievers earned a significantly 
higher test score than either thelow achievers or 
the withdrawals (р <. 001); differences between 
the low achievers and the withdrawals, however, 
were not significant. 

Similar results were obtained within curricu- 
lum 2. An analysis of variance showed an over- 
all significant difference between subgroups (F = 
52.41, p <, 001), and subsequent critical ratio 
tests revealed that high achievers exceeded at the 
‚001 level of significance the test scores of both 
the low achievers and the withdrawals. Again, 
differences in test scores between the low achiev- 
ers and the withdrawals were not significant. 

It may be surmised from these findings that 
the differences in grades attained by the sub- 
groups or their decision to withdraw may reflect 
differences in basic abilities. Within a curricu- 
lum group, the students withdrawing and the low 
achievers seem to have about equal abilities, but 
the high achievers are clearly superior to both. 
In a previous study by Guthrie (1), а correlation 
of .49 was found for four-year engineering stu- 
dents between scores on the four-part total of the 
ability test and grade-point ауе rages. Although 
no correlational study was made on two-year 
technical students, it is quite probable that asim- 
ilar relationship exists within that curric ulum. 
It would seem likely then, that many ofthe cur- 


riculum 1 low achievers and withdrawals might 
achieve high grade-point averages within curric- 
ulum 2. On the other hand, it is probablethat the 
majority of curriculum 2high achievers would not 
achieve similarlyhigh grade-point averages in 
curriculum 1. 

Interests. TheStrong VocationalInterest Test 
yields interest scores which can be expressed in 
letter grades of A, В+, B, B-, С+, C, and C-; 
respectively, these grades can be considered to 
range from indications of interests very close to 
the majority of people already engaged in a par- 
ticular occupation to indications of interests quite 
dissimilar to the majority of people in that occu- 
pation. According to Strong's viewpoint that 
**when hiring а man for a position, it is recom- 
mended that ће be considered to ha v e passed the 
interest test for that occupation if he obtains an 
А or a B+ rating. .."'(3, рр. 3-4), there were on- 
ly five areas out of the 24 examined in which any 
subgroup ‘‘passed’’ the interest testof an occupa- 
tion. 

These five areas were chemist, engineer, 
mathematics-science teacher, farmer and occu- 
pational group II (a composite of the firsttwo are- 
as). In both the chemist and the engineer cate- 
gories, only the high and low achievers in curric- 
ulum 1 and the high achievers in curriculum 2 
passed the interest tests. In the mathematics- 
Science teacher category, these same three groups 
passed plus the withdrawals in curriculum 1. All 
subgroups passed the interest tests in the farmer 
category and in the group П composite. It seems 
then, that there is sometendency for achievement 
in the curriculums and interest in engineering and 
chemistry to go together, and to a somewhat 1ез- 
ser extent, for achievement and interest in teach- 
ing mathematics and scienceto go toge ther. 
Where interests differentiate then, the distinction 
seems to be more on the basis of degree of aca- 
demic success than on curriculums. 

Table III shows the degree of similarity of in- 
terests of all subgroup comparisons. In the body 
of the table are shown the number of interest are- 
as of the 24 measured in which two compared 
subgroups received identical medianletter grades. 
The rows show the number of identical median 
letter grades and the columns under which the two 
numbers in a row are located indicate the two 
subgroups being compared. Thus, itis seen at 
the top of the table body, for example, that there 
were 20 out of 24 interest areas in which curric- 
ulum 1 high achievers and curriculum 1 low a- 
chievers received identical median letter grades 
and, at the bottom of the table, that there were 
nine interest areas out of 24 in which curriculum 
1 low achievers and curriculum 2 low achievers 
received identical median letter grades. 

In considering possible transfer of students be- 
tween curriculums, the important findings reveal- 
ed by the table are that curriculum 1 low achiev- 
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TABLE II 


COMPARISON OF MEAN SCORES ON THE ABILITY TEST OF STUDENTS 
IN CURRICULUM 1 AND STUDENTS IN CURRICULUM 2 


Subgroup and Curriculum 1 Curriculum 2 
Test Section Mean S.D. Mean S.D. 


High Achievers 


Arithmetic 24.99 4.03 19.50 4.25 
Algebra 28. 62 3.14 19. 87 6.56 
Four-Part Total 140. 46 21.61 112.95 22.86 


Low Achievers 


Arithmetic 22.14 4.17 15. 68 4.14 
Algebra 26.46 3.55 15.98 5.77 
Four-Part Total 127. 50 20.03 92.76 20. 35 
Withdrawals 

Arithmetic 22.09 4.80 16.86 5.18 
Algebra 26.03 4.24 15.95 5.76 
Four-Part Total 124.85 21.58 98. 00 22.90 
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TABLE III 


THE NUMBER OF INTEREST AREAS OF THE TWENTY-FOUR MEASURED IN WHICH THE 
VARIOUS PAIRED SUBGROUPS OBTAINED IDENTIC AL MELIAN LETTER GRADES 


Curriculum 1 Curriculum 2 
High Achievers Low Achievers Withdrawals High Achievers Low Achievers Withdrawals 
Bose 20 
Nesp ote ce Beet en el 18 
ЕЕ ee НИ 17 
[eee 17 
| ———— 16 
е ен анны 16 
вене 16 
1B сес сона 15 
v 14 
12--------------------------------------------------................ 12 
11--------------------------------------------------------------------- 11 
11--------------------------------------------------------........................ 11 
Tace 11 
-——— ——S. 9 
—————— M————— 9 
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ers are quite similar ininterest to curriculum 1 
high achievers, and to a somewhat lesser extent, 
to curriculum 2 high achievers. Onthe basis of 
interest then, curriculum 1 low achievers would 
probably adapt well enough within curriculum 2. 

The curriculum 1 withdrawals are most like 
the curriculum 2 low achievers and curriculum 2 
withdrawals. Itis possible then, that ifthese 
latter two groups are disinterested in curriculum 
2 (as evidenced by withdrawal or substandard a- 
chievement), thecurriculum 1 withdrawals might 
also be disinterested. It should be noted though, 
that these curriculum 1 withdrawals are still fair- 
ly similar in interests to the high achievers in 
curriculum 2, so that some basis exists for be- 
lieving that this group also might adapt well with- 
in curriculum 2. 

The curriculum 2 high achievers exhibit inter- 
est patterns more similar to groups in curricu- 
lum 1 than to groups in curriculum 2. It might 
be expected then, that they might adapt well with- 
in curriculum 1. 

On the basis of the assumption that interest 
patterns and success in a curriculum tend to go 
together, one might approve curriculum 1 low a- 
chievers transferring to curriculum 2 and with 
somewhat less confidence app rove curriculum 1 
withdrawals transferring to curriculum 2. Cur- 
riculum 2 high achievers might be approved to 
transfer to curriculum 1, although this too would 
be a somewhat tenuous approval. 

Considering both abilities and interests ‚ it 
Seems probable that curriculum 1 low achievers 
would perform well and adjust adequately in cur- 
riculum 2. Curriculum 1 withdrawals would also 
be capable of performing well in curriculum 2, 
but the degree to which they might adjust ade- 
quately to the program isless certain. Finally, 
curriculum 2 high achievers would probably not 
be able to perform well in curriculum 1 because 
of lack of ability, although their interest patterns 
seem compatible with the program. It would 
seem desirable in these latter cases, forthe pur- 
poses of effective selection, to consider transfers 
on an individual basis rather than on agroupbasis. 
The possibility of any success withincurriculum 
1 for curriculum 2 low achievers and withdrawals 
seems very remote. 


Summary and Conclusions 


Students enrolling in 1956 in the four-year en- 
gineering curriculum (called curriculum 1) at the 
Penn State main campus, were compared in aca- 
demic achievement, aptitude, and interests to 
students enrolling at that same time in the t wo- 
year technical program in engineering at the uni- 
versity centers (called curriculum 2). It was 
found that the percentage of students within each 
curriculum exhibiting clear-cut academic success 
in their first semester was about the same. There 


was a significantly greater percentage of students 
withdrawing from curriculum 1, however. When 
members of each curriculum were categorized 
according to grade point average of two or above 
(high achievers), grade point average below two 
(low achievers), and withdrawal from the univer- 
Sity, it was found that the lowest mean scores in 
ability tests obtained by any curriculum 1 sub- 
group exceeded the highest mean score obtained 
by any curriculum 2 subgroup. Furthermore, 
degree of success within acurriculum and ability 
Scores seemed to be directly related. 

When interests were considered according to 
the same categorizations, it was found that inter- 
ests and degree of success seemed to be more 
related than interests and curriculum. The high 
achievers in both curriculums generally exhibited 
stronger interests in engineering and chemistry, 
than did either the low achievers or the withdraw- 
als. Only five occupational areas were found, 
out of a total of 24 measured, in which any sub- 
group exhibited similar interests to people en- 
gaged in an occupation. These were engineering, 
chemistry, farmer, mathematics-science teach- 
er and a composite area, group П. 

It is felt that many of thehigh achievers ш сиг- 
riculum 2 probably would not fare so well aca- 
demically within curriculum 1 because of lesser 
abilities, although their interests are like high a- 
chievers in curriculum 1. Onthe other hand, 
many of the curriculum 1 low achievers and pos- 
Sibly the cirriculum 1 withdrawals might do quite 
well within curriculum 2. The interests of the 
curriculum 1 low achievers seem more clearly 
pertinent to pursuit of an engineering career than 
do the interests of the curriculum 1 withdrawals, 
however. Accordingly it would seem wise to 
consider the merits of the individual case before 
recommending that a student withdr awing from 


the four-year curriculum pursue atwo-year pro- 
gram. 


FOOTNOTES 


l. Grade Point Averages were computed by mul- 
tiplying the number of credits for the course 
by the numerical value for the letter grade, 
where А = 4, B= 3, C-2,D-1,F- 0, and 
dividing by the total number of credits. 


2. The 24 occupational categories and groups of 
categories were: medical, architecture, 
artist, group II (mathematics, еп gineer, 
chemist), farmer, math-science teacher, 
forest service, group V (YMCA physical di- 
rector, personnel manager, social science 
teacher, minister), and group VIII (account- 
ant, office man), group IX (life insurance), 
group X (advertiser, lawyer), and musician. 
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AN OBJECTIVE AND EMPIRICAL STUDY OF 
THE EFFECTS OF LABORATORY EXPERIENCE 
IN A PROFESSIONAL EDUCATION COURSE 
PRIOR TO STUDENT TEACHING 


DAN COX 
Southern Illinois University, Carbondale, Illinois 


* FIRST OF ALL the teacher's attitude will 
limit in a very real way her progress in learning 
to teach. It will determine the kinds of modifica- 
tions that she is willing to attempt in her teaching, 
the energy with which the charges are purs ued, 
and the learning that takes place (1), " 

The attitude of the prospective teacher would 
seem to loom as a vital determinant in predicting 
the success of a teacher as attested by thefore- 


going statement. 
Considerable research has been done to mea- 


sure the effect of student teaching upon the atti- 
tude of teaching candidates during student teach- 
ing. These reports indicate that student teaching 
is probably in many respects the most important 
single course in the professional preparation of 
teachers. Since student teaching is largely а 
laboratory-type course and so significant in the 
education of teachers, it appears then that pre- 
student teaching courses with laboratory experi- 
ences would also improvea teacher’s preparation. 
Therefore, the purpose of this research is to de- 
termine attitudinal changes of teaching candidates 
that resulted from laboratory experiences when 
these experiences are a feature ofa pre-student 
teaching course, Human Growthand Development. 


The Problem 


es of prospective teachers change 
ofessional laboratory experience 
prior to student teaching? The aim 1$ pedem 1) 
to determine the direction and extent of с! ipe 
of attitude toward children during the per io а oi 
experimentation as measured by the Minnes E 
Teacher Attitude Inventory, and 2) to но ^ 
the relationship between these object ive ng 

sured attitudes and empirically measure р- 
praisals as determined by the prospective teach- 


ers. 


Do the attitud 
as a result of pr 


*Footnotes will be found at the end of the article. 


Sources of Data 


The sample for this study was drawn from jun- 
iors and seniors at a southwestern state teachers 
college who were enrolled in a professional edu- 
cation course, Human Growth and Developm ent. 
The majority of the students were between 20 and 
22 years of age at the time ofthe study. One hun- 
dred and twenty-two cases were included in this 
study. The attitudes of the prospective teachers 
toward school work and toward pupils were mea- 
sured objectively by the use of the Minnesota 
Teachers AttitudeInventory (MTAI) and the em- 
pirical device of personal appraisal was used. 


Procedure 


Objective Measure. The MTAI was adminis- 
tered to all students enrolled in the course, Hu- 
man Growth and Development, at thebeginning 
and again at the end of the course. The students 
were told that the MTAI scores would be kept in 
confidence and would not be used in grading. The 
students were randomly div ided into cont rol and 
experimental groups. Themembersofthe exper- 
imental groups were assigned to children and 
youth organizations of the community. Each stu- 
dent worked with his group for a period of nine 
consecutive weeks. Organizations to which mem- 
bers of the experimental group were assigned 
were: Boy and Girl Scouts, Cub and Brownie 
Scouts, De Molay, RainbowGirls, Saturday Morn- 
ing Study Hour and Saturday Morning Playground. 
The members of the experimental grouphad 
course instruction plus the laboratory feature. 
The members of the control group rec eived only 
the course of instruction. All sections of the 
class contained members from both control and 
experimental groups. * 

Table I is a summary of significance of the 
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ТАВГЕ 1 


А SUMMARY OF SIGNIFICANCE OF THE DIFFERENCES BETWEEN THE 
EXPERIMENTAL AND CONTROL GROUPS FROM PRE-TEST TO | 
POST-TEST FOR FALL AND SPRING SEMESTERS ON TEST | 

OF MINNESOTA TEACHER ATTITUDE INVENTORY 

| 


SSS | 


Group Mean S.D. S. E. of S. E. Dif. t t. 01 t. 05 Null Hyp. 8 
Меап of Means Е | 
= ЕССЕ ЕЕ 
> 
Fall Exp. ғ 
9 
Рге-Теѕі 29.18 28.95 4.64 Bl 
3.37 6. 98 2.11 2.02 Rej. at .01 5 | 
Post- Test 52. 70 31.61 5.07 5 | 
| 
Fall Control 5 | 
Pre-Test 21.85 34.70 5.56 d 
4.15 5.18 2:71 2.01 Rej. at .01 » 
Post-Test 43.35 35. 70 5.72 Rej. at .05 p 
9 | 
Spring Exp. S 
Pre-Test 34.71 29. 90 6. 69 Я 
9. 14 5.73 2.84 2.09 Rej. at .01 p 
Post-Test 55.05 271.85 6.23 
Spring Control 
Pre-Test 28.00 33. 60 5.52 
9.08 8.99 2.84 2.09 Rej. at . 01 
Post- Test 50.71 32.25 1.21 


сох 


ы TABLE П 


TEST OF SIGNIFICANCE BETWEEN GAINS OF EXPERIMENTAL AND CONTROL 
GROUPS OF FALL SEMESTER ON MINNESOTA TEACHER ATTITUDE INVENTORY 


Student No. Experimental Control Student No. Experimental Control 
Gain ge Gain ge Gain ge Gain ge 
1 5 2 21 21 36 
2 22 17 22 14 -1 
3 9 23 23 77 21 
| 4 21 6 24 19 41 
қ 5 -17 24 25 18 20 
| 6 29 12 26 24 23 
7 57 68 27 28 25 
| 8 12 45 28 14 38 
М 
| 9 2 56 29 -12 35 
| 10 -12 -15 30 27 36 
| 11 36 18 31 0 13 
4 
| 12 31 52 32 45 -9 
13 36 61 33 41 -7 
14 27 53 34 73 44 
14 
15 33 1 35 17 
16 16 -7 36 44 16 
17 24 25 37 34 -10 
| 18 14 -22 38 28 41 
{ 19 24 8 39 -21 12 
| 20 51 | 49 40 36 57 
| 
Em ове = 21. 00 oMge = 3.37 
я # a x oge = 22. 93 оМес = 3.71 


t= .086 
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TABLE III 


TEST OF SIGNIFICANCE BETWEEN GAINS OF EXPERIMENTAL 
AND CONTROL GROUPS OF SPRING SEMESTER ON 
MINNESOTA TEACHER ATTITUDE INVENTORY 


Student No. Experimental Gain ge Control Gain ge 
1 32 0 
2 -10 8 
3 36 42 
4 13 -11 
5 35 -2 
6 23 6 
7 7 37 
8 39 13 
9 29 9 
10 9 25 
11 42 50 
12 -7 11 
13 13 35 
14 41 30 
15 28 55 
16 44 29 
17 33 34 
18 10 33 
19 -21 39 
20 -17 28 
21 48 6 
Experimental gain = 427 Control gain - 477 
Mge - 20. 33 oge - 20.5 oMge = 4.59 
Мес = 22.71 oge = 17.72 oMgc = 3.96 


t= „39 


differences for the experimental and control 
groups from pre-test to post-test for the fall and 
Spring semesters. 

Table I indicates that both experimental and 
both control groups made statistically significant 
gains during the experimental period. The null 
hypothesis was rejected by all four groups at the 
201 level of confidence . Therefore, it is a 5- 
sumed that this change in attitude can be attribu- 
ted to the instruction. 


Compared with Corr 


Attitudinal Changes of Experimental Groups as 
esponding Control Groups 


Objective Measure. Fall Semester. These 
OIC с. - А 
data are treated in terms 01 mean gains. Table 


П compares the fall semester experimental group 
with the corresponding control group. The ex- 
perimental group achieved a mean gain of 23. 58 
points on the MTAI from pre-test to post-test. 
The corresponding control group made a mean 
gain of 23.15. The experimental gain 5. D. was 
21. The control gain S.D. was 22.93. The S.E. 
of the mean gain of the control group was 3.71. 
The “47 test resulted in ratio of .086. Therefore, 
the significance of the experimental group over 
the control group was not significant at the .01 


level of confidence. 
Spring Semester. Table Ш reveals the results 


of the test of significance between the control and 
experimental groups for the spring semester. 
The results are based upon the gain scores made 
by the groups as a whole and are the results of 
the pre-test and post-test of the MTAI One may 
observe that the experimental group--the group 
whose members were assigned to profess ional 
laboratory experiences--earned amean gain of 
92.71. Іп ап attempt to determine the signifi- 
cance of the differences between these two groups, 
it was found to be .39. This difference is not 
significant at either the . 01 or ће .05level of 
ех Меазиге. Тһе students of the ex- 
perimental groups completed a form with the fol- 
lowing directions: “Describe your reac tions to 
your experiences which you have had this semes- 
ter in your work with your community activity as- 
signment. Try to relate your rem a dg to Pag 
knowledge and understanding of boys an gir 24. 
is not necessary that you sign your name. k = 
participants were told that the written ong 
they were about to prepare would not be re 
a number of weeks and that the accounts were an 
attempt to evaluate the program. | 

‘The major purpose for asking for this type 
information was so that the conclusions might е 
compared with the results of the objective mea- 
sure mentioned above. 


These subjective accounts were completed and 
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gathered. Later they were read and in respect 
to subjective evaluation, it should be remember- 
ed that it is the total effect of the answers which 
are important rather than thespecific aspects 
considered singly. 

Sims (2) method was used for classifying the 
subjective accounts. 

The participants of the studyindicated that 
there was considerable personal value in their 
laboratory experiences. The extent of the value 
was varied. АП the subjects did not find the 
greatest value in the same area. Several pointed 
out that the laboratory activity gave meaning to 
the theory discussed in class. Others seemed to 
feel that the actual experience of working with 
youngsters helped them to establish their present 
ability as a guide of children. Others pointed out 
that the experiences helped them to understand 
children and mentioned their enthusiasm for more 
work with children and youth. 


Conclusions 


The following conclusions were drawn from the 
data which were presented in this study: 


Objective Instrument 


1. The gain from pre-test to post-test was 
significant at the .01 percent level of c o nfidence 
for all groups. 

2. The experimental groups did not show a 
statistically significant gain over the correspond- 
ing control groups. 


Empirical Instrument 


1. The empirical measure strongly indicated 
the value of professional experience prior to stu- 
dent teaching in the preparation of teachers when 
the experiences are a requirement for a course 
related to human growth and development. 

Empirical evidence strongly supports the the- 
sis that the attitudes of prospective teachers 
toward teaching can be improved as a result of а 
professional education course, Human Growth and 
Development. The objective evidence did not 
support empirical evidence. 
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TABLE IV 


SUMMARY ОЁ THE DISTRIBUTION OF PARTICIPANTS' 


SUBJEC TIVE 


ACCOUNTS AS TO THE VALUE OF THEIR LABORATORY EXPERIENCES 


Group Classification Number Percent 
I Superior Report 35 57. 37 
п Ауегаре Нерогї 24 39.34 
ш Inferior Report 2 3.28 
Total 61 99.99 


FOOTNOTE 


The author has chosen to use acluster sample 
rather than a random sampling technique because 
of class size and time. It is believedthat gener- 
alizations from this group's results to succeed- 
ing classes at this college can be made from the 
results of this experiment, hence inferential sta- 
tistics are used in the treatment of the data here 
presented. | | 

The students who participated in the experi- 
ment were not matched into pairs; therefore, the 
following formula was used to determine the ef- 
fect of professional laboratory experiences upon 
their attitude toward teaching. The formula, 

{ = Mx - My 


Ya; Mx + ??My - 2r xy?Mx?My 


was applied to the results of the MTAI which was 
used as the objective measure in this study. The 
above formula established the significance of the 
difference of means for pre-test to post-test for 
eachgroup. It was then necess ary to compare 
each experimental group's performance with the 
corresponding control group's performance for 
the data. For these data, the following formula 
was used: 


t- Mge - Mgc 


УдаМре + °2Mec i 


The “t”? obtained was interpreted in terms of the 
desired level of confidence (.01) through refer- 
ence to Fisher’s special table of <>, 
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ING LIKERT-TYPE ATTITUDE ITEMS' 


WILLARD E. NORTH 
JOHN SCHMID** 
University of Arkansas 


Introduction 


A NUMBER of years ago, Rundquist and Sletto 
(2) found that the phrasing of questions in attitude 
and personality sc ales affected the nature of re- 
sponses. Their results suggested that reconsid- 
eration of the phraseology of items used in the 
Air Force for assessing job satisfaction was in 
order. 

Examination of the attitude items revealed 
several inconsistencies in item phraseology. Of 
those variations detected, two types predominated. 
It was noted that some items were stated with a 
personal orientation for the respondee, while 
others were stated with an impersonal orientation. 
The second inconsistency in item construction 
was that some items contained a qualifying phrase 
while others did not. 

As examples of how an attitude item might be 
stated with either a personal or impersonal orien- 
tation, consider the following two items: 1) “Му 
supervisor is excellent;’’ and 2) “Аг Force su- 
pervisors are excellent." In responding to the 
first item, the subject is requiredto consider only 
his own superv isor, while the second item re- 
quiresthe subject to considerthe Air Force super- 
visors in general. узе | 

Examples of the second type of variation, i.e. , 
items with and without qualifying phrases are giv- 

ng two items: «Му supervisor 15 


en by the followi s \ 
excellent; апа “Му supervisor 15 betterthan any 


other supervisor I might have had. " The first 
item requires the respondee to agree or disagree 
with the statement about the categorical excellence 
of his supervisor. The second item permits the 
respondee to have а qualification built into his re- 
sponse. Hemustagreeor disagree with the state- 
ment on the relative excellence of his supervisor 
when compared with other supervisors, but the 


* This investigation was carried out ш 
port of Project No. 1950. Permission 
disposalin whole or in part by or fort 


**Both authors were with the Pers 


out under the Air 
is granted for reproduction, 
he United States Government. 


subject need not give his supervisor his unquali- 
fied endorsement. Thus, it may be seen that а 
proposition intended to serve as an attitude item 
might be phrased inatleast four ways as shown in 
the following example: 


Unqualified 


My supervisor 
is excellent 


Qualified 
My supervisor 
isbetter than 


Personal- other supervis- 
ized orsImight have 
had. 
Air Force su- Air Force su- 
Imperson- pervisors are pervisors are 
alized excellent. betterthanthose 
found in civilian 
life. 


Question was raised about the effect of the type 
of phrasing upon statistical characteristics, such 
as internal consistency, test-retest reliability, and 
independence of attitude areas. Because of the 
youthfulness of the airmen 5 ubjects, the Imper- 
sonalized-Qualified type of items were dropped 
from the study. The majority of subjects would 
have had very little opportunity to compare the Air 
Force job environment with that found in civilian 
life. 


Hypotheses 


Three hypotheses were developed, one for each 
of the three statistical characteristics to be exam- 
ined in this study. 

Hypothesis I: Personalized-Qualified items 
will produce the most internally consistent scales; 
Personalized-Unqualified items will produce less 
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internally consistent scales; and Impersonalized- 
Unqualified ite ms will yield the least internally 
consistent scales. 

Hypothesis II: Personalized-Qualified items 
will produce scales with the highest test-retest 
reliability; Personalized-U nq ualified items will 
produce scales that are less reliable; and Imper- 
sonalized-Unqualified items willyield scales with 
the lest test-retest reliability. 

Hypothesis ПІ: Impersonalized-U nquali fied 
type items will demonstrate the highest inter- 
area correlations when measures on several atti- 
tude areas are obtained. Personalized-Unquali- 
fied type items will produce the second highest 
inter-area correlations. Personalized-Qualified 
type items willyieldthe lowest inter-area corre- 
lations. Lowinter-area correlations are, of 

course, deemed important for diagnosticity. 


Procedure 


For this study five areasof job satisfaction or 
attitude derived from a previous factor an alysis 
study were used (3). These were designated as: 
Supervisors, Air Force Bureaucracy, Co-work- 
ers, Living Conditions, and Job. For each of 
these five areas of job sat isfaction, five-item 
Scales representingthethreetypes of item struc- 
ture were developed. The same basic five items 
were used for each of the three scales, but were 
modified so that one scale contained the items 
written in a personalized-qualified fashion; а sec- 
ond scale contained the same items written in a 
personalized-unqualified fashion; and the third 
Scale contained these items written in an imper- 
sonalized-unqualified fashion. 

The above procedure resulted in a total of 75 
items. In order to control for possible order ef- 
fect, theitems were partially randomized in such 
a fashion that each 15-item segment contained an 
item representing each of the three-item types 
from each of thefive areas; i. e., each of the five 
areas of job satisfaction was measured by five 
items written with the personalized-qualified 
phraseology, five items written with the person- 

alized-unqualified phraseology, and five items 
written with the impersonalized-unqualified 
phraseology. Items were assigned to each seg- 
ment of the survey using a table of random num- 
bers. Atable of random numbers was also used 
to order the fifteen items within each segment. 
Making use of this partial randomization proced- 
ure, two forms were prepared. The only differ- 
ence in the two forms was the order of item pre- 
sentation. One form was labeled A; theother form 
was labeled B. 

A totalof 199 subjects was obtained. The 
subjects were enlisted personnel from one Strate- 
gic Àir Command Air Force Base who were at- 
tending a two-week indoctrination school. Form 
А of the survey was administered on the first day 


of the school and Form B administered on the last 
day. A standard five response IBM answer sheet 
was used. The subjects were instructed to mark 
Aifthey strongly agreed with the statement, B if 
they agreed, C if they were uncertain, D if they 
disagreed, and E if they strongly disagreed. 

It was decided to score item responses dichot- 
omously rather than use the five-point scale. The 
strongly-agree and agree responses were combined 
and the disagree and strongly-disagree responses 
were alsocombined. The neutral or uncertain re- 
sponse Was assigned to the unfavorable-attitude 
side of the dichotomy. The total score for each of 
the five scales was the number of favorable re- 
Sponses. Each scale, therefore, had a possible 
range of zero through five. 


Results 


Scale Means and Standard Deviations— The 
Scale means are presented in Table I. “Although 
it is not necessary to examine the means for eval- 
uation of the three hypotheses, a rather interest- 
ing result does occur. For five areas, the sub- 
jects responded more favo rably when using the 
Personalized-Unqualified item type than when us- 
ing the other two. When scales, using the Person- 
alized-Qualified and Imper Sonalized-Unqualified 
item types are compared, no consistent results 
are observed. 

The scale standard deviations are presented in 
Table II. The standard deviations tend to be some- 
what larger for the Personalized item types than 
for the Impersonalized item types. Between the 
two Personalized item types the differences are 
quite small and a number of inversions may be not- 
ed. Thus it would appear that any differences 
found in reliabilities for the different item type 
Scales are probably attributable to factors other 
than differences in Standard deviations. 

Internal Сопѕіѕіепсу— Ну pothesis І states that 

the Personalized-Qualitied type of item would have 
the highest internal consistency and Personalized- 
Unqualified and Impersonalized- Unqualified item 
types would be dec reasingly internally consistent 
inthat order. To deter mine the consistency of 
each scale, the Kuder-Richardson Formula 20 was 
used. These results are presented in Table III. 
. Itis seen that the Impersonalized- Unqualified 
item type scales have lowest internal consistency 
with the exception of Form A of the Job area. In 
the other four areas there appears to be no differ- 
ences betweenthe Personalized-Qualified and Per- 
Sonalized- Unqualified items. It appears that the 
data only partially supports Hypothesis I. 

Test-Retest Reliabilities — Hypothesis II states 
that the Person alized-Qualified item type would 
demonstrate the highest test-retest reliability and 
that the Personalized- Unqualified and theImper- 
sonalized- Unqualified item types would show de- 
creasing reliabilities in that Order. The Person- 


& е UM E — P 
TABLEI 
JOB SATISFACTION SCALE MEANS BY AREA AND ITEM TYPE 
Air Force Living 
Supervisor Bureaucracy Co-workers Conditions Job 
Item Type A* в А B A B A B A B 
Personalized- 
Qualified 2.46 2.40 2.15 2.16 3. 40 3.41 1. 09 .91 2. 12 2. 83 
Personalized- 
Unqualified 3. 29 3. 26 2.70 2.60 3.7 3. 80 1. 80 1.50 3. 60 3. 62 
Impersonalized- 
Unqualified 2. 70 2.89 2.11 2. 31 2. 12 3. 03 1. 29 1. 00 3. 30 3.53 
2 
ж [Initial Test 9 
**Retest H 
= 
а 
ТАВІЕ П am 
JOB SATISFACTION SCALE STANDARD DEVIATIONS BY AREA AND ITEM TYPE B 
Air Force Living 
Supervisor Bureaucracy Co-workers Conditions Job 
]tem Type A* ве А B A B A B A B 
Personalized- 
Qualified 1. 78 1.87 1.83 2.03 1. 68 1. 69 1. 38 1. 40 1.54 1.54 
Personalized- 
Unqualified 1. 75 1. 66 1. 86 2.01 1.61 1. 84 1. 58 1. 64 1.57 1.53 
Impersonalized- 
Unqualified 1.17 1. 18 1:73 1.91 1. 63 1. 75 1. 32 1. 28 1.58 1. 44 


ж Initial Test 
**Retest 
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TABLE VI 


MEDIAN INTER-AREA CORRELATIONS FOR EACH ITEM TYPE 


Initial Test Retest 
Personalized- 
Qualified +155 . 161 
Personalized- 
Unqualified .259 . 193 
Impersonalized- 
Unqualified . 307 . 256 


alized-Qualified and the Personalized- Unqualified 
item types show approximately equal test-retest 
reliabilities fortwo attitude areas (see Table IV). 
For the otherthree areas, the Personalized-Un- 
qualified item scales are slightly less reliable. 
The Im personalized-Unqualified item type con- 
sistently shows the lowest test-retest reliabili- 
ties. Again the hypothesis seems to be partially 
supported. 

Area Intercorrelations— Hypothesis III states 
that the five areas of job satisfaction would show 
the greatest independency for the Personalized- 
Qualified types, with the Personalized- Unquali- 
fied and Impersonalized ty pes showing greater 
dependency in that order. Table V shows all the 
intercorrelations of the three item types for the 
five job satisfaction areas. 

To examine Hypothesis III, median corr ela- 
tions of the five attitude areas for each type sep- 
arately were computed. This was done for the 
initial testing and retesting separately (see Table 
VI. The median inter-area correlations sug- 
gests that Hypothesis III is substantiated. 


Conclusions 
The Personalized item type appears to be su- 


perior to the Impersonalized item type in terms 
of the statistical characteristics examined in this 


study. Regarding thetwoforms of the Personal- 
ized items, differences аге not too conclusive for 
the Qualified and the Unqualified phrasing on in- 
ternal consistency. However, on test-retest re- 
liability and independency of attitude areas, the 
Qualified form seems superior. For purposes of 
diagnosticity, this is important (1). In general, 
the evidence suggests that if the attitude object 
lends itself to all three types of phraseology, it 
would seem that the Personalized-Qualified type 
of item phrasing is the best. 
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MOTIVES IN SELECTING ELEMENTARY AND 


SECONDARY SCHOOL TEACHING’ 


GERHARD LANG 
Fairleigh Dickinson University, Teaneck, New Jersey 


SEVERAL STUDIES have sought to determine 
motives for teaching. Recently, Lloyd-Jones (14), 
Chaltas (3), and Lang (11) have surveyed the rel- 
evant previous research. Interviews (8, 1 6), 
questionnaires (1, 5, 8, 17, 19, 22, 31), and es- 
says on the theme ‘‘Why I want to teach” (7, 32) 
were the devices most frequently employed. Gen- 
erally, in view of the critical teacher shortage, 
the direction of these studies was focused on find- 
ing answers to immediate problems, rather than 
on testing hypotheses derived from theory. 

Theories of vocational choice, the concept of 
the multi-dimensionality of the teacher role, and 
studies of teacher personality provide a theoreti- 
cal framework for research in this area. 

Personality is considered to be an impor ant 
determinant of vocational choice (21, 24), which 
is, to a large extent, an expression of basic psy- 
chological needs (6). Studies have 5 hown that 
there are personality characteristics which dif- 
ferentiate between (20) as well as within (10, 15) 

ional groups. 
Professiomerally recognized that the modern 
teacher plays many roles inside the class о; 
(18, 23). Atthe elementary апа аї the pecon аў 
level, some roles more than others ten = о = 
emphasized. For instance, the elementary — 
er confronts her pupils predominantly as ee E 
er-substitute, whereas the secondary = em 
her role of subject-matter Spec ialist, fun 


imari i arning. It seems rea- 
primarily as director of le ng. Eb 


Sonable to assume that one of i the-other 
Sons why women select one rather t Dine de 
level of teaching is the fact that they I е 
tivities associated with the teaching role арр 
priate to that level. а "n 
The findings of studies of teachers’ persone 
ties (15, 25-27) and teachers' classroon рате 
(28, 29) suggest that teaching SERERE ей that 
outlet for certain psychological nee ae e teach 
these may differ for individuals — е 
at the elementary or secondary level. 


a doctoral disser 
for the Degree О 


m tation (11 
Based, in part, on 
of the requirements 


f Doctor of phil 


The purpose of this study was to determine to 
what extent these differences, if any exist, are 
reflected in the motives for choosing the teaching 
profession. Motives forteaching were operation- 
ally defined as : (a) reasons comprising the Lang 
Scale of Motives for Teaching and (b) psychologi- 
cal needs measured by the Edwards Personal 
Preference Schedule. 

Two hypotheses were tested: (a) elementary 
teachers will emphasize motives relating to the 
mothering aspects of teaching, (b)secondary 
teachers will emphasize motives relating tothe 
academic and intellectual facets of teaching. 


Subjects, Instruments 


The subjects of this study were 101 female ele- 
mentary and 87 female secondary teachers, 21-29 
years of age, and currently teaching in 16 New 
York City public schools. T heir experience 
ranged from one month to 10 years. 

The Lang Scale of Motives for Teaching (12) 
and the Edwards Personal P reference Schedule 
(4) were the data-gathering devices of this study. 

The Lang Scale measures the degree to which 
(i.e. “least”, ''slightly", ‘thalf/half’’, ‘‘much’’, 
*tmost") each of 25 reasons has influenced a sub- 
ject to choose teaching. Checklists used in pre- 
vious investigations listed reasons suchas “1 like 
working with children’’ which may be considered 
to be generally admired and socially desirable. 
In constructing the Lang scale, an effort was 
made to include reasons, such as “І like to be in 
a position of authority’’, which evoke varying de- 
grees of social approval. Judgments of 60 people, 
18 educators and 42 non-educators were used in 
determining the social acceptability values of 
each of 76 potential reasons for teaching, in ac- 
cordance with Thurstone’s method of equal ap- 
pearing intervals (30). The bases for selecting 
25 reasons for inclusion in the scale were (a) the 
assumed appropriateness of the reason for either 


) submitted to Columbia University in partial fulfillment 
osophy. 
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the elementary or secondarylevel of teaching and 
(b) the usual criteria governing the development 
of a Thurstone-type scale (30). 

The Edwards Personal Preference Schedule, 
consisting of 210 pairs of statements, is designed 
to measure the relative importance of 15 psycho- 
logical needs based on the subjects' self-descrip- 
tions. Each pair of statements is matched ap- 
proximately for mean social desirability value, 
as previously judged by 86 men and 66 women, in 
order to minimize the effectof social desirability 
on item choice. 


Procedure 


The subjects were asked to complete a brief 
background questionnaire andthen to consider the 
degree to which each of 25 reasons has influenced 
their choice of teaching as their profession. They 
were asked to check three reasons which were 
most influential in their choice, three reasons 
which were least influential, five reasons which 
were slightly, and five reasons which were much 
influential. The nine remainingreasons were 
those considered to be about half/half infl u en tial 
in their decision to teach. The EPPS was admin- 
istered with the standard instructions printed on 
the test booklets. The dataof subjects who incor- 
rectly responded to the Scale of Motives and/or 
received a consistency score ofless than 10 on 
the EPPS were not used. The two instruments 
were responded to anonymously. 


Results 


1. Both elementary and secondary school 
teachers rated as most influential reasons which 
are socially acceptable; they rated as least influ- 
ential reasons which are socially unacceptable. 
АП rank difference correlations obtained between 
social acceptability values of the reasons and fre- 
quency of checkings by subjects in the two re- 
sponse categories were significant at better than 
the . 001 level of significance. 

2. Elementary teachers emphasized the rea- 
sons ‘‘I like working with children" (X - 14.86, 
р<. 001) and ‘‘I like to give to and to receive love 
from children" (X? = 12.97, p «. 005). 

3. Secondary teachers emphasizedthe reasons 
“I like the continuous opportunity to learn" (X? = 
6.77, p< 05) and “I enjoy the intellectual fellow- 
ship of other teachers" (X? - 20. 11, р<.001). 

4. Elementary teachers manifested a greater 
п. Nurturance (г = .23, р<. 001) and lesser п' A- 
chievement (r = .12, p«.05) than did secondary 
uw-—-- of the other motives differentiated 
significantly between the two groups of teachers. 


Discussion 


Findings of past research implied that, gener- 
ally, teachers state reasons for teachi ng which 
might be considered socially acceptable. However, 
the validity of this deduction has not been shown. 
Previous investigators were not concerned with 
Social acceptability per se as a factor to be stud- 
ied. Generally, their subjects had not been given 
the opportunity to respond anon ymously, a fact 
which may have been instrumental in their volun- 
teering primarily socially desirable reasons. 
Furthermore, in most Studies, teachers were con- 
fronted with a limited array of reasons, most of 
Which were of a socially acc eptable nature. In 
this study, the subjects responded anonymously to 
a scale comprising a wide variety of reasons which 
were selected on the basis of psychological theory. 


Social acceptability values were accurately deter- 
mined and not arbitrarily inferred. 


The results show that teachers, even when 
promised anonymity, will emphasize Socially ac- 
ceptable reasons for selec ting teaching. In this 
respect, elementary and Secondary teachers are 
alike. Apparently, teachers are either reluctant 
and/or unable to admit the powerful sway of mo- 
tives which are socially less desirable. In private 
communications, teachers will agree that teaching 
is a convenient job for a woman. Yet only 19 
teachers (10%) regarded this reason as most in- 
fluential in their choice of teaching despite the 
fact that this motive ranked in the middle of the 
Social acceptability continuum. On the other hand, 
the reason “I like working with children", which 
ranked highest on the continuum was checked by 
116 teachers (62%) as being most influential. 

The avoidance of less desirable reasons is 
probably a reflection of the conforming behavior 
which our society imposes on teachers, who, in 
their role as Surrogates of middle class morality, 
may be reluctant to admit to motives which are at 


variance with the established values of society (2, 


Preference for the socially desirable reasons 
tiay be also attributable to the fact that most of 
e sul 


And yet, Jersild (9), 
that the expression of 
a widespread phe- 


nomenon which serves as a defens e against the 


teacher’s own anxiety. 

In a recent study, Jersild (9) has elicited а 
variety of additional intrapsychic problems ex- 
perienced by teachers, such as loneliness ,the 
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search for life's meaning, sexual conflicts, and 
lack of the freedom to feel. The majority of 
teachers who responded to his questionnaire ac- 
cepted the idea that a major goalin education 
should be to help young people to understand and 
accept themselves. Furthermore, the vast ma- 
jority of teachers saw thenecessity of their grow- 
ing in self-understanding and welcomed the oppor- 
tunity to discuss personal and emotional issues 
confronting them in workshops, special courses, 
and group therapy. The process of self-dis cov- 
ery on the part of teachers involves, among other 
things, a recognition of their motives for teaching 
and an understanding of their personality needs. 
Even though certain motives may appear to be 
somewhat far fetched or repugnant, they may nev- 
ertheless be strong factors in their choice of а 
teaching career. 

The Scale of Motives for Teaching which has 
served as a research instrument may be useful 
as a tool in counseling pre-service as well as in- 
service teachers. In discussing their responses 
to this scale, teachers may be helped to “асе 
themselves" by examining their m otives for 
teaching and, in doing 50, may better understand 
their personality needs. | 

The hypothesized differences in motives be- 
tween female elementary and secondary teachers 
were supported. The findings suggest that pos- 
sibly one important reason why female el ementary 
teachers are attracted to teaching 15 that they like 
the activities associated with the teacher role of 
mother-substitute. They seem to like the com- 
panionship of children andto desire giving and re- 
ceiving love from them. These teachers, appa 
ently, like to treat others with kindness, п. о 
be generous with others, and desire to have others 
confide in them about personal problems, charac- 
sociated with n: Nurturance. 

female secondary teachers, the 
data suggest that they see ш teaching an opportun- 
it i e learning Of O ) 
their Pigs for knowledge, and to enjoy the 
i i i ally stimulating fellow 
companionship of intellectually Саве 
teachers. Apparently, theylike to be poet h Ло 
desire to be regarded аз ап authority, eere 
accomplish something of great signi zm и 
Strive to do things helter тер d a 
teristics indicative of п’ Achiev . 
The apparent attraction of elementary teachers 


5 secondary teach- 
to the emotional and that of the еттен does ubt 


ers to the intellectual facets of 1 са 
imply that the latter do not wantto estat oth levels 
Personal ties with others. Tea ет significant- 
like to be with people and do по entary 


х dert female elem 
ly in m Affiliation. However, ema o people who 


teachers apparently like t receptive to 


те relatively immature, ne сргосаїе. Female 
RO 
Ove, and who are har + "bor han d, seem to 


Secondary teachers, оп 


Prefer people who are relatively 


on a reciprocal basis, can serve as outlets for 
their intellectual needs. 

The finding of statistically significant differen- 
ces in motives between female elementary and se- 
condary teachers should not conceal the fact that 
there is considerable variability within each teach- 
inglevel. Furthermore, in view of the selective 
nature of the sample studied—New York teachers 
—inferences to the population of female American 
teachers may not be warranted. Comparable 
studies, drawing upon samples in different local- 
ities throughout the country, are indicated. 


Summary 


It has been suggested that teaching satisfies 
certain psychological needs and that these may 
differ for individuals who elect to teach at the el- 
ementary or secondary level. The present study 
sought to determine to what extent these differen- 
ces, if any, are reflected in motives for choosing 
the teaching profession. The Lang scale of Mo- 
tives for Teaching andthe EPPS were administer- 
ed to 101 female elementary and87 female secon- 
dary teachers, 21-29 years of age, teaching in 16 
New York City public schools. 

Motives for teaching emphasized by elementary 
teachers related to the ‘‘mothering’’ role; those 
stressed by secondary teachers involved the ''di- 
rector of learning" role. Elementary teachers 
rhanifested a greater n: Nurturance and lesser n 
Achievement than did secondary teachers. The 
two groups of teachers жеге similar with regard 
to the social acceptability of reasons perceived as 
influential in their choice of teaching. 

The data support the view that female elemen- 
tary and secondary teachers differ in some aspects 
of their personality. However, the differences 
found in the present study, though statistically 
significant, are not large enough to warrant a 
broad generalization. 
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Introduction 


. THE CHILD'S self-concept arises and develops 
in an interpersonal setting (30). Feelings about 
the self are established early in life and are mod- 
ified by subsequent experiences. Amongthe sig- 
nificant people believedto affect the child’s feel- 
ites about himself are first, his parents, and, 
ater, his teachers. Ausubel (2) and Jourard and 
Remy (16) are among the few investigators who 
have reported results which support these theo- 


retical contentions. 

Rogers (24), Snygg and Combs (27), among 
ot ers, assignthe self-concept a central place in 
their personality theories and suggest that the in- 
dividual's self-concept is a major factor influ- 
encing his behavior. Vigorous research in this 
area by Martire (17) and Steiner (28) has produced 
Corroborative evidence for these views. 

i Only recently has the concept of the self been 
atroduced into the school setting. Typical studies 

те those by Jersild (15), Reeder (23) and Stev- 
ens (29). Jersild demonstrated the value of the 
Self-concept theory in making the educative pro- 
Feng more valuable. Reeder, using grade school 
Children and Stevens, working with college stu- 

ents, explored the relation between self-concept 
and school achievement. Both of these investi- 


Bators found that positive feelings about the self 
ic achievement. 


are associated with good academ А 
ге] Series of studies dealing with teacher-pupi 
Se ations have sought to determine a) how children 
tes апа feel about their teacher? (11); b) how 
and Chers see and feel about thelr pupils (5, 20); 

€) how teachers think their pupils see them- 


Selves (22) 
It has be i i hat teachers in- 
t S been widely recognized tha 1 
репе the personality development of their pu- 
5 (21). perkins, for example, found that 


* : 
This study was supported by а grant from the Ja 


teachers who had completed several years of child 
study were able to promote healthier personality 
growth in children, defined in terms of congru- 
ency between the self and the ideal self. For this 
reason, many researchers, among them, Barr 
and Jones (3) andSymonds (31) are engaged in the 
study of personality development of the teacher 
herself. 

Despite the abundance of research on these а5- 
pects of the school setting, an important dimen- 
sion, not previously investigated, is how the child 
perceives his teacher’s feelings toward him. In 
an investigation of this interaction, we not only 
may gain insight into the question of what qualities 
make for an effective teacher but also an under- 
standing of howthe child’s perception of his teach- 
er’s feelings, irrespective of its accuracy, re- 


lates to his self concept, school achievement and 


classroom behavior. 
It is the purpose of this investigation to deter- 


mine what the relation is between children’s per- 
f their teachers’ feelings towardthem and 


ception о: 
erception, academic achieve- 


the variables: self-p 
ment, and classroom behavior. 
Specifically, three hypotheses were tested: 


1. There exists a positive correlation between 
children’s perception of their teachers’ feelings 
toward them and children’s perception of them- 
selves. In pehavioral terms it is predicted that 
the more favorable the child’s perception of him- 
self, the more pos itive will be his perception of 
teachers’ feelings toward him. 

2. There exists apositive relationship between 
favorable perception ofteachers’ feelings and good 


academic achievement. 
3. There exists a positive relationship between 


favorable perception of teachers’ feelings and de- 
sirable classroom behavior. 


mes McKeen Cattell Fund. 
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The Instrument 


Totest thehypotheses proposed, it was nec- 
essary to develop an instrument to measure self 
perception and the perception of the feelings of 
others. It was decided to use an adjective check- 
ing method, since itis direct and simple. Adjec- 
tive check lists have been used to measure ad- 
justment (18), self acceptance (4), empathy (9), 
character traits (13), and to distinguish the self 
perceptions of persons classified according to 
Some social and psychological variables (26). In 
the main, these lists have been used with adults. 

In developing the check list with children, 
words and phrases to be in cluded were selected 
on the basis of the following three criteria: 


1. The words should be those commonly used 
to describe how people feel toward and how people 
think of others, e Specially how teachers feel 
toward and think of children. An attempt was 
made to cover varied aspects of behavior and per- 
Sonality. For this purpose, lists already devel- 
Oped, like those of Allport (1), Gough (12), and 
Hartshorne and May (1 3), were scanned for appro- 
priate words. 

2. The words should be easy enough for chil- 
dren in approximately the 10-16 year age range 
to read and comprehend. The Thorndike-Lorge 
Frequency Count (33) was usedto eliminate words 
which would be too difficult. 

3. The list should contain about an equal num- 
ber of words connoting positive and negative feel- 
ings. 


From an initial pool of 200 trait names, 135 
remained after the application of criteria 1 and 2. 
The next step was to determine the feelingtone of 
the 135 words. Eachofthe words was then rated 
by 35 teachers and 50 junior high-school pupils as 
favorable, unfavorable, or neutral. Only those 
words were retained which were judged by more 
than 80% of the teachers and 80% of the pupils as 
being favorable or unfavorable. The words judged 
neutral were eliminated. 

Fifty words remained after the teachers and 
students judgedthem as favorable or unfavorable. 
The 35 words finally used are listed below along 
with the Е or О rating received. Fifteen words 

were dropped either because of the level of diffi- 
culty or because of some duplication in meaning. 


Fair (F) A hard worker (F) 
A nuisance (U) Bad (U) 
Afraid (U) A good sport (F) 
Cheerful (F) Considerate (F) 
A time waster (U) Not eager to study (U) 
Neat (F) Helpful (F) 
Not eager to learn (U) Careless (U) 
A leader (F) Sociable (F) 
Unhappy (U) Clever (F) 
Loving (F) Not alert (U) 


Outstanding (F) Smart (F) 
Loud (U) Silly (U) 
Generous (Е) Kind (F) 
Nervous (U) Shy (U) 
Sensible (Е) А sloppy worker (U) 
Polite (Е) Dependable (F) 
Lazy (U) А day dreamer (U) 
Forgetful (U) 


Administration and Scoring of the Check List— 
The children are instructed to decide how the 
teacher feels toward them with res pect to each 
trait name, and then to rate it ona three-point 
rating scale: most of the time, half of the time, 
seldom or almost never. A favorable word is as- 
signed a score of 3 when it is checked in the most 
of the time column; a score of 2 for half of the 
time, and 1 for seldom or almost never. For an 
unfavorable word the Scoring is reversed, 

The total score, the Index of Favorability, is 
obtained by adding the scores of all the words and 
dividing the total by the number of words checked. 
The higher the index, the more favorable is the 
child's perception of the teacher's feelings toward 
him. Theoretic ally, the index can range from 
1.00 to 3. 00. 

Reliability and Validity— The Checklist of Trait 
Names was administered twice to four classes 
comprising 105 junior high-school children. The 
interval betweenthe two administrations was from 
four to six weeks. A correlation of . 85 was ob- 
tained (rank difference, p <. 001). 

The Checklist may be considered to have logi- 
cal validity. However, it was desired to obtain a 
measure of empirical and concurrent validity. 
This was done by correlating the child's own per- 
ception of his teacher's appraisal of him with his 
classmates? perceptions of the teachers’ feelings 
towardhim. For this purpose, a modified version 
of the de Groat and Thompson Teacher Approval 
and Disapproval Scale (7) was administered along 
with Checklist to 93 children (3 classes). The 
de Groat and Thompson scale, as modified, con- 
sisted of 8 positive st atements, suchas, “Неге 
is someone whom the teacher praises for trying 
hard, ’’ and 8 negative statements, such as, “Неге 
is someone whom the teacher often points out as 
wasting too muchtime."' For each statement, pu- 
pils were askedto name one to four of their class- 
mates to whom these character istics applied. 
They could also name themselves, if they so de- 
sired. Of the 93 children, 56 received 5 or more 
votes on one of the teacher approval and disap- 
proval statements. For these 56 children, a 
teacher approval score was deter m ined by sub- 
tracting the number of unfavorable statements on 
which five or more votes were received from the 
number of favorable statements on which five or 
more votes were received. A correlation of .51 was 
obtained (rank difference, p<.001) between the In- 
dex of Favorability and the teacher approval score. 
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The Checklist d e v eloped to assess children's 
perception oftheirteachers' feelings toward them 
appears to have satisfactory reliability and valid- 
ity. Although the estimate of reliability and val- 
idity was basedon a sample of junior high-school 
students, the list was considered appropriate al- 
so for the upper grades of the elementary school 
because of the way the words were chosen. 


Experimental Design 


Subjects—The subjects of this study were 89 


boys and 114 girls, attending 4th, 5th, and 6th 
grades of a New York City public school. These 
children were distributed in 10 different class- 
rooms. In terms of reading ability, the classes 
Selected were in the upper half of their respec- 
tive grade level. Originally, it was planned to 
test all 4th, 5th, and 6th grade children, but after 
preliminary experimentation, it was found that 
Several words were too difficult for children of 
limited language ability. It was therefore decid- 
ed to test children in those classes which were 
known to have the better readers. | 
The children represented а wide range in 
socio-economic status. It was possible to divide 
them into three distinct groups on the basis of 
their fathers’ and mothers’ occupation. The up- 
per group, consisting of 63 children, came from 
families of profession al people, white collar 
workers and business men; the middle social class 


group of 57 children had parents who were skilled 
workers, policemen and firemen; the low group 
contained 83 children of semi-skilled E un- 
Skilled umber of unemployed. | 

ee d ound information 


А Table I presents the epp es 
or the 20 i involved in the . 
3 children i dot Trait Names — 


Procedure— The Checkli у 
adsninistered twice to the children. At the first 
administration, the children were instructed to 
respond to the 35 adjectives с om prising the c 
in terms of «Му teacher thinksI am, and at = 
Second testing, in terms of «тпк Iam." Т s 
first testing was done in the morning, the second 
inthe afternoon. The ''My teacher thinks I am 


i feel- 
Scale yi e of perceived teacher 
: yields a measur Е 4s the Index of Fa- 


caleyields а meas- 


n and one man, rated 
i hievement, on a four- 
rt ‘Below Av- 
sis of data, 
i e 
the last two categories W ombined due to th 
Panelty of cases in the categor =) 
Same time, the teacher also ee 
On 10 behavioral or personality Са ee 
Weight of +1 was assigned to each 0 


Judged i ће four desirable traits 
ged to be desirable. T prie im аввен!те. 


Were: ea P 
5 er, obedient, соор нн 
Weight of -1 was given to he characteristics 


judged to be undesirable: disorderly, destructive, 
hostile, defiant, unfriendly, and troublesome. 
The sum of the weights yielded a behavior rating 
score ranging theoretically, from +4 (very desir- 
able) to -6 (very undesirable). Subjects who re- 
ceived the 0 and minus behavioral ratings were 
combined into one group due to the small number 
of cases in these categories. 


Results and Discussion 


Hypothesis 1— There exists a positive correla- 
tion between children's perception of their teach- 
ers! feelings toward them and children's percep- 
tion of themselves. 

The two perceptual favorability indexes corre- 
lated . 82 (product-moment, p <. 001). The chil- 
dren who had a more favorableora more adequate 
self-concept, that is, those who achieved a high- 
er self-perception score also perceived their 
teachers’ feelings toward them more favorably. 

The finding of a significant correlation between 
the two kinds of perception lends support to the 
view that a child’s assessment of himself is relat- 
ed to the assessment “significant people" make 
of him (30). In two previous research investiga- 
tions, aclose relationship was found between self- 
appraisal and children’s perception of their par- 
ents’ feelings toward them (2,16). The present 
study for the first time has shown that a child’s 
self-appraisal is significantly related to his per- 
ception of his teacher’s feelings as well. Sucha 
finding was anticipated in view of the fact that one 
role ofthe teacher, at least at the elementary lev- 
el, is that of а “parent substitute." Several in- 
terestingquestions may be raised: To what extent 
does a child's perception of his teacher's feelings 
resemble his perception of his mother'sor father's 
feelings toward him? Does the child's perception 
of his present teacher differ from his perception 
of his previous teacher ? Does favorability or per- 
ception decrease or increase with years in school? 

Hypothesis о _ There exists a positive relation- 
ship between favorable perception of teachers' 
feelings and academic achievement. Table II pre- 
sents the mean favorability scores and their stand- 
ard deviations for the three levels of estimated 
achievement. The Fratioof 15. 61 was significant 
at less than the .001level. The three t tests were 
also significant at better than the . 01 Tevel. 

Hypothesis 3— There existsa positive relation- 
ship between favor able perception of teachers* 
feelings and desirable classroom behavior. The 
findings pertaining to the relationship between 
children's perception and their classroom behav- 


ior are shown in Table III. 

The overall F ratio of 7. 38 was significant at 
less than the 7001 level. The only significant t 
tests werethose between the lowest category (0 and 
less) andallthe other categories. Inother words, 


the children who were rated as being disorderly, 
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TABLE II 


INDEX OF FAVORABILITY AS RELATED TO THREE LEVELS OF 
ESTIMATED ACHIEVEMENT 


Achievement Category 


Very Well Adequately Below Average 
Mean Favorability Score 2. 68* 2.57 2. 40 
у (N=53) (N=111) (N=39) 
. 22 .24 „25 


8. D. 


*The higher the score, the more favorable the child's perception of his teacher's feelings 


toward him. 


TABLE Ш 


AS RELATED TO FIVE LEVELS OF RATED BEHAVIOR 


INDEX OF FAVORABILITY 


Behavior Rating Category 


in irable Undesirabl 
Very Desir able Desiral я sira : 
(+4 +3) (+2 +1) Minus Scores) 
* 2.65 2.58 2.53 2. 39 
Mean Favorability Score (6: is (5:54) 8 mag an 
m a .28 
6 ‚ 19 | 
S. D. E 
favorable the child's perception of his teacher's feelings 
re 


*The higher the score; the mo 


toward him. 
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defiant, unfriendly, or troublesome, perceived 
their teachers' feelings toward them as being less 
favorable than the children who were rated as be- 
ing eager, Cooperative, assertive and the like. 
One of the axioms of educational psychology is 
the statement that a child learns only when he is 
motivated to learn. Furthermore, the basic in- 


able to his teacher. We may 
with the child's behavior. The child who achieves 
Well and behaves Satisfactorily is bound to please 
his teacher. She, inturn ; Communicates posi- 
tive feelings toward the c hild, thus reinforcing 
his desire to be а. good pupil. Which of these var- 


lables serves as the primary determiner is a fact 
difficult to ascertain, 


personally. 

It should be emphasized that these findings do 
not imply causality but rather Suggest that certain 
pupil characteristics, such as Self-perception, 
perceived teacher feelings, achievement and be- 
havior in school are interrelated. 

In addition tothe results relevant to the tested 
hypotheses, other findings will now be reported, 

Sex Differences—Sex differen ces were ob- 
served with regard to the three variables studied: 
index of favorability, * achievement, апа behav- 
ior in school. Girls perceived their teachers 

feelings toward them more favorably than Ша the 
boys (girls mean - 2. 60; boys mean - 2, T 
2.41, p<.02). The behavior ratings of the gir 5 
were more favorable than those of the boys (ха = 
10. 72, df = 4, р <. 05); the girls were likewise 
rated more favorably in ги ee 
this difference was not significant (x? = 3. 41, d 
= <. 20). 
| ужи A consistently shown that 
teachers report more problem behavior among 
(32). One explanation, though not widely ac- 
ед d, is that boys are naturally more aggres- 
2t “Another view, more plausible, holds that 
ciety encourages aggressive behavior in теп 
aos to be) and submissive behavior in wom- 


Teachers, most of whom are women, espe- 
en. 


cially in the primary grades, therefore regard 
boys’ classroom behavior as di Sturbingly differ- 
ent from the norms of behavior appropriate to their 
own female sex. The temptation is great to re- 
ward children of one’s own sex, Meyer and 
Thompson’s study (19) is pertinent here. Teacher- 
Pupil interaction of sixth-grade pupils were stud- 
ied over a one-year period and analyzed in terms 
of "approval" and “disapproval” contacts. In ad- 


**Guess Who” technique whichof their classmates 
receive their teacher’s approval and disapproval. 


quently made that more men should be urged to 
teachat the primary level, Findings 
discussed above Suggest t 
а sexual balance in the te i 
mary grades. Not only is i 


one would predict. These data are 
shown in Table IV. 


may be observed Írom Table Iv that there is 
а decline in mean favorability index from the up- 
per to the lower Social class. Two of the three t 
tests were Significant at better than the . 01 level; 
t was not Significant between the upper and middle 
Social class groups. Children in the two advan- 
taged social class groups perceive their teachers’ 
feelings toward them more favorably than do the 
children in the lower class group. 
Social class and achievement in School are sig- 
nificantly related (x2 = 18, 38, 4df, p<, 01). The 


upper social class 43% of the children were 
by their teachers as doing very well ins 


Social class and behavior in school as rated by 


| ist score of the child's percep- 
The i in this and subs quent analyses is e Check Li 
h ndex used in y hi 


i d him. 
tion of his teacher's feelings towar 


су == mm 
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TABLE IV 


SOCIAL CLASS STATUS RELATED TO FAVORABILITY INDEX, 
ACHIEVEMENT AND BEHAVIOR 


Upper Social Middle Social Lower Social 
Class Class Class 
(N=63) (N=57) (N=83) 
Mean Favorability Index 2. 63 2. 60 2. 49 
S. D. .26 . 22 .26 
Achievement Rating 
Category: 
Very Well 4 
(N=53) 43%* 34% 23% 
Adequately 22 47 
(N-111) 31% % % 
Below Average 36% 49% 
(N-39) 15% 
Behavioral Rating 
Category: 
Very Desirable 41% 29% 30% 
(N-94) 
Desirable 30% 46% 
2 
(N-69) ы 
Undesirable 20% 22% 58% 


(N=40) 
pased on the N’s of the Achievement and Behavior categories. 
а. 


*These percentages are 
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the teachers were not significantly related (x? = 
14.97, 8df,.05 <p<.10). However, the distri- 
bution of children in the several categories re- 
veal interesting differences. While the great 
majority of the children in the group were rated 
favorably by their teachers, there were 58% of 
the children in the lower class whose behavior 
was rated as undesirable while only 20% of the 
upper class children were so rated. 

It has been suggested that teachers, as surro- 
gates of middle class values, tendto give prefer- 
ential treatment to the middle and upper social 
€conomic class pupils, and to withhold rewards 
from pupils who belong to the lower socio-eco- 
nomic class (6, 8). Furthermore, previous re- 
search has shown that lower class children do not 
achieve as well as middle and upper class chil- 
dren (10, 14), in part due to lower motivation 
(25). The data obtained in the present study cor- 
roborate these observations. 

The interrelations found between children’s 
perception of teachers’ feelings, school achieve- 
ment, behavior and socio-economic status are 
particularly significant since ће majority of chil- 
dren in the public schools throughout the country 
come from families of low social class status. It 
is therefore likely that a lower class child, es- 
pecially if he is not doing well in School, will have 
а negative perception of his teachers’ feelings 
toward him. These negative perceptions will in 
turn (епа (о lower his efforts to achieve in school 
and/or increase the probability that he will mis- 
behave. His poor school achievement will aggra- 
vate the negative attitudes of his teachers toward 
him, which in turn willaffect his self-confidence, 
andsoon. This vicious entanglement must be in- 
terrupted at some point. The point of attack may 
well betheteacher whose capacity to reflect feel- 
ings conducive to the child's growth should be of 
concern to educators. 

Analysis of Variance of Favorability Scores— 
It was found that the index of favorability was pos- 
itively related to achievement in school as well as 

to social class position. It is also evident from 
this and other studies that achievement in school 
iscorrelated with social class position. In order 
to study the influence of each of these factors on 
index of favorability, the favorability scores were 
re-analyzed first, for the three achievement lev- 
els within each social class and second, for the 
three socialclass groups within each achievement 
category. The mean favorability indexes for 
these separate groups are presented in Table V. 
Reading Table V vertically, it may beobserved 
that the mean favorability score declines from 
the upper social class to the lowest Social class 
for each of the achievement categories; this de- 
cline is most noticeable between the two highest 
Social class groups and the lowest social class 
group. It is apparent that the social class vari- 


able plays a part in the way a child perceives his 
teacher's feelings toward him regardless of his 
achievement in school. Similarly, reading Table 
V horizontally, the mean favorability score is ob- 
Served to decrease from the highest achievement 
level to the lowest within each Social class group. 
The evidence here suggests that achievement in 
School colors the child's perception of his teach- 
er's feelings, regardless of his social class posi- 
tion. Analysis of variance of the data yielded two 
Significant F ratios. These results indicate that 
both the factors of social class position and 
achievement are operating independently in affect- 
ing the way a child will perceive his teacher's feel- 
ings toward him. 

These findings should arouse the educator for 
they imply that a teacher's reaction to a child is 
is not solely influenced by the individuality of the 
child but also by his social class and achievement 
characteristics. 

Differences Among Teachers — It may be as- 
sumed that teachers reflect a variety of feelings 
toward children, either because of their own per- 
Sonality needs, or because of the way they use 
punishment or praise or for any other reason. 
These differences from teacher to teacher should 
be observable in the perceptions of the children 
affected by them. Table VIpresents the mean fa- 
vorability indexes for the 10 teachers inthis study. 

It may be observed that the range in mean fa- 
vorability score is from 2. 25 to 2.70. Although 
the children generally perceived their teachers’ 
feelings more favorably than otherwise, and the 
actual differences among the classrooms were not 
large, there were 3 or 4 classrooms with marked- 
ly low mean scores. The overall F ratio of 2.95 
15 significant at less than the . 01 level. It should 
be remembered, at this point, thatthe classes 
were selected for better than average ability in 
reading, which makes the finding of significant dif- 
ferences even more compelling. Teachers do 
seem to vary in their inclination and/or their ca- 
pacity to communicate favorable feelings. It seems 
urgent that teachers be helped to recognize the 
significance of the feelings which they express 
toward children, consciously or unconsciously, 
Some teachers, in addition, may need the help 
which can only come through a process of self- 
understanding, in order to avoid or to minimize 
the expression of negatively-toned feelings toward 
children, because of their sex » their socio-eco- 
nomic status, their behavior or achievement in 
school. 

Possible Uses of the Checklist. The Checklist 
of Trait Names, inadditionto its use as a research 
tool, may be adapted to practical School situations. 
Conceivably, it can be e m ployed for the purpose 
of teacher selection and guidance. For instance, 
a principal might wish to select а teacher for a 
class comprised of under privileged or trouble- 
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TABLE V 


TY FOR THE THREE ACHIEVEMENT CATEGORIES 


MEAN INDEXES OF FAVORABILI 
AND FOR THE THREE SOCIAL CLASS GROUPS 


Achievement Category 


Very Well Adequately Below Average 
Upper Social Class 2,71% 2. 61 2.51 
(N-23) (N-34) (N- 6) 
Middle Social Class 5-4.” Qua) ў т 
Lower Social Class to nee) Es m 


*The higher the score, the more favorable the child's perception of his teacher's feelings 
toward him. 


TABLE VI 


THE INDEX OF FAVORABILITY FOR THE TEN CLASSROOMS 


"m 26 52, 61% ‚26 
5-1 18 2.25 .21 
5-2 8 2.45 . 29 
сый 27 2.62 E 
T 23 2.45 . 23 
5-5 25 2. 62 . 22 
17 2.51 .08 
6-1 
5 20 2.64 .23 
6- 
23 2. 64 . 19 
6-3 
16 2.70 .10 
6-4 
he score, the more favorable the child’s perception 


«Тһе higher t toward him. 


of his teacher's feelings 
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some children who are very much in need of ac- 
ceptance andapproval. A good candidate for such 
a class would bea teacher who can easily project 
positive feelings. Supervisors of student teach- 
ers may find the checklist useful in evaluating the 
quality of teacher-student relations. 

Teachers who are found to communicate largely 
negative feelings may be advisedto participate in 
some kind of counseling or ther apy. Similarly, 
children whose perceptions are primarily nega- 
tive and/or distorted can be identified for person- 
ality diagnosis and thus be helped in self-under- 


standing or in obtaining a more accurate percep- 
tion of reality. 


Summary 


The purpose of the Study was to relate chil- 
dren's perception of their te а сћег5' feelings to- 
мага them to self-perception, academic achieve- 
ment, and classroom behavior. A Checklist of 
Trait Names, consisting of 35 descriptive terms, 
was administered to 89 boys and 114 girls in 
grades 4, 5, and 6 та New York City public school, 
The children were rated by their teachers for 
achievement and on a number of behavioral char- 
acteristics. 

The major findi ngs were: 1) The children’s 
perception of their teachers’ feelings toward them 
correlated positively and significantly with self- 
perception. The child with the more favorable 
self image was the one who more likely than not 
perceived his teacher’s feelings toward him more 


favorably. 2) The more positive the children’s 
perception of their teachers’ feelings, the better 
was their academic achievement and the more de- 
sirable their classroom behavior as rated by the 
teachers. 3) Further, children in the upper and 
middle social class groups perceived their teach- 
ers’ feelings toward them more favorably than 
did the children in the lower social class group. 
4) Social class position was also found to be pos- 
itively related with achieveme nt in school. 
5) However, even when the favorability index data 
were re-analyzed separately for each Social class 
and for each achievement category, the mean fa- 
vorability index declined with decline in achieve- 
ment level, regardless of social class position 
and, similarly, the mean ға vorability index de- 
clined with social class regardless of achieve- 
ment level. 6) Girls ge nerally perceived their 
teachers’ feelings more favorably than did the 
boys. 7) Finally, there were some significant 
classroom differences in the favorability of the 
children’s perception of their teachers’ feelings. 
These findings must be considered in light of the 
non-random selection of the sample. Neverthe- 
less, it is reasonable to as Sume that these sub- 
jects are representative of the population of New 
York City elementary school с hildren at these 
grade levels. | 

Possible uses of the Checklist were suggested. 
AS a result of this investigation, a number of 
changes in the Checklist were indicated, The new 
form along with instructions, used ina study at 
the junior high school level, is given below. 


CHECKLIST (New Form) 


We are asking your cooperation in a Study being conducted at 
teacher feels toward you. 


you think your 


Now read the following and do the example: 


On the next page are pairs of words. In each p 
steps between the pairs of words, as shown below. 


PLEASANT. ^ | B 


air, one is the Opposite of the othe ғ; 


Our interest is in the way 


There are five 


D E 


Consider the words PLEASANT and UNPLEASANT. Here is wh с 
your teacher judges you as being pleasant most of the time, put an X inthe“ A” 
teacher considers you to be unpleasant most of the time, place an X in the “p” 
teacher considers you to be pleasant so m etimes and unpleasa 
feel your teacher considers you to be somewhat more pleasant 
If you feel your teacher considers you to be somewhat more unpleasant than pleasant, р] 


box marked “D”. 


in the middle of the box whi 
do the example. Be sure to place an X in 
з eases feels about you. Do not worry or puzzle over anyone word. 


ing that we want. Do not omit any word. 


UNPLEASANT 


at you are supposed to do. If you feel 


box. If you feel your 


box. If you feel your 
nt sometimes, mark the «c» box. If you 


than unpleasant, put an Xinthe “В” box. 
асе ап X in the 


ch describes most nearly how 
It is your immediate feel- 


Be as honest as you can. Neither your teacher nor your principal will see your paper. 


If you do not understand a word, please raise your hand, and t 


explain it to you. 
ЕТЕК THE PAGE AND BEGIN. 


he Examiner will come to your seat and 
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Name 
| А(в|с|вр(Е 
Selfish Unselfish Wise | Foolish 
Obedient Disobedient | Rude Г] Polite 
ЊЕ 1 
Intelligent Unintelligent | Alert Lazy 
Good Bad Passive Active 
— 
Sad ГІСІ Нарру Reliable Unreliable 
EE өре 
Slow | | Fast Nice Awful 
Clean Dirty Unpopular Popular 
Strong | [= | Curious Indifferent 
т 
Cowardly ШЕИ Careless Careful 
—_ aa " 
Honest ELI Daring | Afraid 
im 
Childish T Mature 
Calm E ШИШЕСИН _|___|_ 
Unfair = Attentive | Inattentive 
G Disorderly [ Orderly 
НЕ Е 
і Ungrateful Grateful 
чы Cie [qe 1 
Unfriend ШЕТЕН Respectful | Disrespectful 
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PSYCHOLOGICAL SERVICES IN TWENTY- 
EIGHT ELEMENTARY SCHOOLS 
OF COLUMBUS, OHIO 


OPAL E. PARMER 
Board of Education, Columbus, Ohio 


ioe E VALUE of psychological services for a 
qe .City school system has never seriously been 
ime OE The demand usually exceeds the 
a This is true not only in a large city, but 
don in county and state services. This study was 
ma е in an effort to clarify the major areas of de- 

nd for psychological services inthe elementary 


Schools of Columbus, Ohio. | 
if К. purpose of this study was: 1) © determine 
ез meal services were being distributed 
cordin among the various elementary schools ac- 
Sch ing to their enrollments; 2) to determine ifthe 
Sols with high achievement records requ 1 red 

e Same type and amount of services as those 


wi 3 
ith low achievement records; 3) © determine the 
children were 


1 n 
he Of difficulties the elementary ' 
is and 4) to see if the difficulties were i 
i er 
вада © through parental guidance and o 


Enrol 
lment 
mentary schools 


There were twenty-eight ele 
am in this study. Tuis equalled 30. 43 percent 
5 jbroximately one-third) of the total elementary 
Bin ог ап enrollment as of Мау, + " 
22548 children in grades kinde rgarten throug 
Table I shows the enrollments of the various 
АП but three schools had more boys than 


Birls ; There was 8.88 percent more ade 
in the schools where this study was made. 
thas be compared with the 5. Dae mo 

: i t o 
the Peu mee а Ва T ја able П наа 
s eed and percent who received psycholog". 
Who welstance acoording to schools: E E 
Prese ere boys or girls. In all schools Е A ot 
qua ted More concerns than the girls. ит e 
ы У of the schools having ? high ог 

ent record. 

езе ш inan the number and api 
Терор en who were over-age for the grade um 
сата to the psychologist for assistance | 
“eq е (61. 15% of those tested) had been 

®Ssroom concerns for 


The majority of them had repeated at least one 
grade. A few had come from other school ѕуѕ- 
tems or other states where the attendance laws 
vary. 

A comparison between the high and low a- 
chievement schools indicated 49 overage children 
received assistance from the top quartile group 
while 110 overage children receiv ed assistance 


from the lowest quartile group. 


Achievement 


The rank of academic achievement for the 
ools used in this study was determined by the 
school’s standing when compared with the total 
elementary schools of the city. The city-wide a- 
chievement test scores for sixth grade were used 
as a basis of comparison. 

It was learned that of the twenty-eight schools 
used, 21.43 percent ranked high, 3.57 percent 
ranked above average, 28. 57 percent ranked av- 
erage, 17.86 percent ranked below average, and 
28.57 percent ranked low. 

A comparison between the achievement scores 
and the socio-economic status of the children 
within the schools correlated proportionately.The 
schools are grouped in the Tables according to 
their academic achievement records for the past 


two years. 
There were 32.14 percent of the schools in this 


study who had a special class program to assist 
the children who, on individual intelligence test 
scores, placed between the 50 and 751.Q. range 
An additional 7. 14 percent of the schools not hav- 
ing а special class program this year plan to in- 
clude it in their curriculum next year. 

One school in this study was designed for han- 
dicapped children. The necessity for its havin 
additional psychological services is greater T 
the overall services used are not as gr eat а. 
would be needed i f these children were instruct а 
in their neighborhood school. Ww 


sch 


Kinds of Difficulties 
К 


The reasons for desiring psychological ser 
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TABLE I 


NUMBERS AND PERCENTAGES OF BOYS MORE THAN GIRLS IN TWENTY-EIGHT 
SCHOOLS OF COLUMBUS, OHIO, IN MAY, 1960 


Schools Enrollment as Boys Girls Boys more than Girls 


Percent more Boys 
of May, 1960 


> 
со 
> 
с 
> 
cs 
© 


8.35 
в 551 269 282 -13 -4.60 
C 273 144 129 15 10.41 
D 276 139 137 2 1.43 
E 678 344 334 10 2.93 
Е 659 350 309 41 11,71 
G 463 256 207 49 19.14 
H 576 304 272 32 10.52 
I 970 497 413 24 4.83 
J 243 134 109 25 18. 65 
K 606 316 290 26 8.22 
T; 184 106 78 28 26.41 
м 281 152 129 23 15.13 
М 343 185 158 27 14.59 
о 800 418 382 36 8. 60 
Р 365 204 161 43 21.07 
Q 616 320 296 24 1.50 
R 297 161 136 25 15.52 
8 475 269 206 63 23. 42 
m 682 367 315 52 14.16 
U 538 290 248 42 14.48 
v 294 144 150 -6 - 
= 819 415 404 11 2.65 ` 
х 697 372 325 41 12.74 
“ 497 229 268 -39 -14. 55 
Р 536 278 258 20 7.19 
АА 549 288 261 27 gsn 
BB 431 ae 213 = ead 
Totals 14, 548 7,612 6, 936 676 8.88 
Bes of OM = 531,035 27,315 25,120 1,595 5.83 


umbus 
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TABLE П 


NUMBERS AND PERCENTAGES OF CHILDREN WHO RECEIVED INDIVIDUAL PSYCHOLOGICAL 
ASSISTANCE IN TWENTY-EIGHT ELEMENTARY SCHOOLS OF COLUMBUS, OHIO, 1959-1960 


School Number tested 


20 
11 
7 
8 


23 


= о т ш OO uU >» 


~ 
= 


= 
o 


13 
28 


N ч х = ч CcCHdomumno'gozszgctnux 
~ 
co 


Percent of enrollment 


2. 


14. 


Percent who were boys 


Percent who were girls 


35 


.99 
.56 
.90 


.39 


00 


.08 
.08 
‚18 


46 


‚14 


67 


.35 
.62 
.87 
.56 


59 


. 68 
.86 
. 01 
.30 
.76 
.90 
.29 
.02 
.03 
.55 
.01 


85. 
12. 
57. 
15. 
65. 
66. 
100. 


100. 


100. 


100. 


00 
73 
15 
00 
22 
67 
00 


00 


.38 


00 


.93 
.86 


00 


. 67 
.18 
.62 
.75 
.00 
.27 
.86 
.15 
.43 
.63 
.87 
.00 
.60 
. 58 


. 93 


.20 


15.00 
27.27 
42.85 
25.00 
34.78 
33.33 
0.0 
0.0 


29.62 
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TABLE Ш 


NUMBERS AND PERCENTAGES OF CHILDREN WHO WERE OVER AGE FOR THE GRADE 
WHEN TESTED IN THE TWENTY-EIGHT ELEMENTARY SCHOOLS OF COLUMBUS 


School Number tested Number over age Percent who were over age 
ái 20 12 60. 00 
B 11 1 9. 99 
с 1 2 28.57 
р 8 5 62.50 
Е 23 9 38.69 
Е 33 15 45. 45 
G 9 5 55.55 
H 12 4 33. 33 
I 27 14 51.82 
| 6 5 83. 84 
® 13 6 46.15 
5 28 21 15.00 
M i 1 100. 00 
N 9 4 44.44 
9 ы п 41.82 
E a 10 76. 92 
9 18 12 15.00 
R > 3 60. 00 
5 28 T 30. 43 
T € 23 56. 09 
U Ц 5 71.42 
у 1a 13 92.85 
w 32 24 15.00 
х 23 21 91.30 
Y 15 1 46. 66 
7, 21 26 96.29 

АА 14 8 57. 14 
вв 13 п 84. 61 
отсе 4T ps 70.21 


Total 520 318 61.15 
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vices have been arranged into five areas. Child- 
ren were classified according to their area of 
greatest need. They were referred by the teach- 
er through the principal to the psy¢ hologist for 
assistance. 

Testing for ability was done when {Не school 
needed to know how much the child was capable of 
learning at that time, or how much he couldab- 
sorb intellectually. 

Requests because of behavior were for those 
children who, because of their mode of acting in 
the presence of others, ог toward them, created 
а situation in which structured learning was im- 
Paired. 

Referrals because of social adjustment were 
for those children who had been uns uccessful in 
establishing an acceptable relationship bet ween 
themselves and their environment. 

Suspected medical reasons were those where 
the physical aspects of the child were to be con- 
sidered, Such children were often suspected of 
having a psychosis or brain injury. The medical 
cases were tested and rechanneled th rough the 
School health department if t | 

. Special class children are retested by ап indi- 
vidual psychological examination еуегу third year 
in compliance with Ohio School Law. The special 
class is structured for instruction at the child's 
mental level of development. Only children hav- 
ing an I.Q. score of from 50 to 75 on an individ- 
T psychological examination and who the se 
thinks would profit from this type homogen ehe 
instruction are placed in thes © classes. T 
Classes are housed within the local community's 


School, 
5 г 
а Outside agencies occasionally ге ques ee 
oh estance in helping them understand somi 2% 
walldren's needs. А written report of our inding: 
S Sent to them pe 
Эз Table IV indicates the reasons why individual 
to yehological testing and 255 is tance Were 5 
a a children, The greate 2 
5 Of ability testing. In fairnes | = 
ne be admitted that many children pos Е 
red for more than one reason: а ђ 


ресі п. 
cially true of those in the Ability oo 
ment comparison between the high je eget 
di Schools indicates 94 tests were n Pam 
dren from the top quartile ú while 75 t ats 
nep da for determining abili! a 
St quartile | кй 
City; group. - — 
Was Y-wide group testing to determ тр 


і i es 
em, Plven in the second and fifth grad 


Магу 5 

Soci chools. 

The 52. adjustment was ће п 
У геј а ог апа adjustment area? 
enyj, ted that most children who 
ifie у етапу were also having ved the 
Chil les. Thi reversely r ее аны NU 
chila en classified in the pehavior section Ж 
Was classified in more than 056 area, 


ext large? 


his seemed advisable. 


ever. 

A comparison between the high andlow a- 
chievement schools indicates nine tests were used 
for children from the top quartile group who were 
having behavior difficulties. Seventeen children 
were having major behavior difficulties among the 
lowest quartile group. 

Similarly, the top quartile group required 37 
tests because of adjustment and the lowest quar- 
tile group required 32. 

Children of the top quartile group surpass ed 
the children of the lowest quartile group 11 to 4 
in medical needs. 

Outside agencies requested assistance for 24 
children. These children are placed inone of the 
other classifications according to their primary 
difficulty. There were three tests given in the 
child's home because of the child's physical im- 
pairment. Four tests were given at the request 
of private physicians, seven were for the Juvenile 
Court; the others were for other agencies of the 
city such as the Catholic Guidance Center or 
Children’s Hospital. 

Tables V and VI show the grade level by num- 
ber and by percent of the children receiving psy- 
chological assistance. Testing atany grade level 
was not done if other assistance and the child’s 
group test scores couldbe used in solving the dif- 
ficulty. Kindergarten test scores were recogniz- 
ed as unstable, especially if the child was hyper- 
active. Most of the kindergarten testing was 
needed for the top quartile schools. 

Testing to identify thegifted was not done since 
the group intelligence tests could be used for this 
purpose at present and other difficulties seemed 


more acute. 
The larges 
1. The deman 


t number of tests was given at Grade 
ds at sixth grade were next. A 
comparison between the high andlow achievement 
schools indicated more tes ting (35 tests) was 
needed for the top quartile sch ools inGrade 1, 
while more testing (31 tests) was needed for the 
lowest quartile schools in Grade 6. Most testing 
and assistance for the top qu artil e schools was 
done in the primary grades while most assistance 
was given the lowest quartile schools inthe inter- 
mediate grades (grades 4, 5, апа 6). 
Table VII shows the intelligence quotient range 
by number and by percent for the 520 children 
iven psychological testing and assistance in the 
twenty-eight elementary schools of this study. 
The cut-off points for the intelligence quotient 
3 s were obtained from the suggested range 
rd-Binet Intelligence Test manual. 
e intelligence (90 - 110 I. Q.) 
most frequently referred for assistan бё, 


were ed | 
The children who were classified as having below 
average intelligence also seemed to have much 
difficulty in school. | 

А comparison between the high and low a- 
chievement schools indicated а need for 52 tests 


REASONS WHY INDIVIDUAL PSYCHOLOGICAL TESTING AND ASSISTANCE WERE GIVEN IN 
TWENTY-EIGHT ELEMENTARY SCHOOLS OF COLUMBUS, OHIO, 1959-1960 


TABLE IV 


=== 


School 


ша ч нм o QA W > 


- 


в г wa 


Ability Behavior Adjustment 

No No No No 
8 40. 00 3 15.00 T 35. 00 2 
4 36. 40 6 54. 60 г 
3 42.85 2 28.57 1 14.29 1 
6 75.00 1 12.50 1 
8 34.19 1 4.34 13 56.53 1 
20 60.60 2 6.06 6 18.19 5 

5 55.55 1 11.11 3 33.34 
4 33.33 2 16. 67 3 25.00 2 
18 66. 60 7 26.00 2 

4 66. 66 2 33.34 
5 38. 47 4 30.75 3 23.09 1 
26 92. 86 i 

1 100. 00 

5 55.55 4 44.45 


Medical 


15. 


16. 


67 


.40 


. 69 


.57 


Special Class Retests 


No. 


8.33 


Outside Agencies* 


No. 


14. 29 


Уст 


NOLLVONGA TIV.ILNSADISdX3 IO тумчпог 


о 16 69. 58 6 26.08 1 4.34 
Р 4 30.77 2 15.39 Т 53.84 
о 8 50.00 2 12.50 5 31.25 1 6.25 
R 2 40.00 3 60.00 1 20. 00 
8 8 34.18 1 4.35 12 41.83 2 8.10 
т 23 56. 10 10 24.39 8 19.51 2 4.88 
U 2 28.57 2 28.57 3 42.86 2 28. 57 
v 6 50.00 5 28.51 3 21.43 1 7.14 
w 17 53.10 3 9.37 9 28.17 1 3:12 2 6.24 2 6.24 
х 6 26.10 4 11.40 1 30.42 1 4.35 5 21.73 1 4.34 
Y 13 86. 64 1 6.68 1 6.68 
g 21 71.80 3 11.10 2 1.40 1 3.70 3 11.10 
АА 4 28. 58 5 35.71 5 35.71 
BB 8 61.53 1 1.69 4 30.78 3 23. 06 
Office 10 21.28 E: 6.38 10 21.28 5 10. 64 19 40. 42 
Total 262 54 


_8 17.02 
143 30 31 24 
Doo TT 
* Children classified under Outside Agencies аге also placed in one of the other classifications depending on their primary difficulty. 


uaWuvd 


сет 


126 JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE V 


GRADE LEVEL BY NUMBER OF CHILDREN GIVEN PSYCHOLOGICAL TESTING AND 
ASSISTANCE IN TWENTY-EIGHT ELEMENTARY SCHOOLS OF COLUMBUS, OHIO 


School Special Kindergarten Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 


Grade 6 
A 1 T 1 1 5 4 1 
в 2 2 3 1 3 
c 4 2 1 
р 2 2 1 3 
E 3 4 1 4 3 5 3 
F 1 15 5 3 6 3 
G 1 8 1 3 1 
H 1 5 2 1 2 1 
1 3 6 11 4 1 2 
Ј 1 5 
к 6 2 3 1 1 
L ? 14 2 1 5 5 
м 1 
М 1 1 1 
v 5 4 3 2 12 
P 2 2 2 2 4 я 
Q 2 1 3 3 2 5 
Е Ы 1 1 1 
5 5 8 3 4 2 1 
т 3 5 10 6 1 2 i 
U 3 3 1 
у 3 2 1 3 5 
w 2 10 3 4 4 5 4 
x 5 1 5 6 2 2 2 
Y в“ 1 3 5 à 4 
7 1 8 4 1 6 1 
АА 2 1 1 4 2 4 
BB 4 1 1 1 Б 
ошсе 19 2 12 5 2 3 3 _ 
Total 30 21 118 76 61 58 58 98 


y 
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TABLE VI 


N GIVEN PSYCHOLOGICAL TESTING AND 


T OF CHILDRE 
NTARY SCHOOLS OF COLUMBUS, OHIO 


GRADE LEVEL BY PERCEN 
EIGHT ELEME 


ASSISTANCE IN TWENTY- 


=== 


Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 


School Special Kindergarten Grade 1 
A 5.00 35.00 5.00 5.00 25.00 20.00 5.00 
B 18.18 18.18 21.21 9.10 20.27 
с 57.14 28.57 14,29 
D 25.00 25.00 12.50 37. 50 
E 13.04 17.39 4.35 17.39 13.04 21.15 13.04 
Е 3.03 45.46 15.15 9.09 18.18 9.09 
с 11.11 33.34 11.11 33. 33 11,11 
" 8.33 пт 198 8.33 16. 67 8.33 
i 11.10 аш Өл 1480 3.70 1.40 
4 19.61 83. 33 
K 46.15 15.38 23.09 7.69 7.89 
" -— 1.14 3.57 17.86 17.86 
Ni we 100. 00 
N id 11.11 77.79 
M " Рр 13.04 8.70 52,17 
» 15.29 15.39 15.39 30. 77 23.06 
" dam 6.25 18.75 18.75 12.50 31.25 
н ке 20. 00 20. 00 20. 00 
ы 21.74 же >> и wi var 
T 7.32 12.19 24.39 14.63 2.44 4.88 34.15 
ü . 42.86 42.86 14.28 
у 14.28 1.14 21.43 35.12 
и 21.43 ЮР" 9.37 12.50 12. 50 15. 62 12. 50 
М 6.25 қ“ 91.73 26.08 8. 69 8. 69 8. 69 
: 21.73 Á н АР" 20.00 33. 33 13.33 20.00 
М o 29.65 14.81 3.70 22. 22 25.92 
а ми T 1.14 28. 58 14.28 28.58 
ў att 1.69 1.69 1.69 46.15 

У ge = z T Ra 

Se 40.42 4,26 
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TABLE УП 


NT FOR CHILDREN GIVEN 
LLIGENCE QUOTIENT RANGE BY NUMBER AND BY PERCE 
"PSYCHOLOGICAL TESTING AND ASSISTANCE IN TWENTY-EIGHT ELEMENTARY SCHOOLS 


ы = al 

ven визи so Toe. „еза ыша ише шш ти 
А 4 25.00 3 15.00 9. 40.00 3 15.00 1 5. 00 20 
B 1 9.00 4 36.40 5 45.60 1 9. 00 11 
с 3 42.85 4 57.15 1 
р 2 2500 2 25.00 3 37.50 1 12.50 8 
Е 3 13.04 7 30.45 в 34.78 2 8.69 3 13.04 23 
F 5 15.15 7 21.21 19 57.38 2 6. 06 33 
G t iid 5 44.44 1 11.11 2 22.22 9 
H 3 25.00 1 8.33 7 58.34 1 8.33 12 
I 9 33.40 10 37.00 8 29.60 27 
J 2 33.34 1 16.67 3 49.99 6 
K 2 15.38 2 15.38 т 53.86 1 7.69 1 7.69 13 
L 1 3.97 9 32.14 9 32.14 7 25.01 1 3.57 1 3.57 28 
м 1 100.00 1 
N 1 ии 3 33.32 з 3332 1 11 11 1 11.11 9 
о 4 11.39 7 30.45 8 34.78 3 13.04 1 4.34 23 
Р 1 7.10 4 30.77 4 30.77 3 23. 06 1 7.70 13 
Q 4 25.00 6 37.50 5 31.95 | 6.25 16 
R 2 40.00 2 40.00 1 20.00 5 
5 1 4.35 11 47.83 8 34.18 3 13. 04 23 
т 10 24.39 13 31.71 15 36.58 1 2.44 2 4.88 41 
U 2 28.90 1 14.28 4 51.15 7 
у 8 57.16 4 28.56 2 14.98 14 
У 4 12.50 20 62.50 4 12.50 3 9.37 1 3.13 32 
x 11 47.86 8 34.77 з 1503 | 4.34 23 
“ 7 46.67 5 33.33 3 20.00 15 
7 11 40.76 13 48.14 3 11.10 27 
AA 2 14.28 5 35.71 6 42.87 | 7.14 14 
BB 7 53.84 4 30.78 1 7.69 1 7.69 13 
Office 16 34.04 8 17.02 11 23.40 10 21.28 22 4.26 47 


Total 22 142 145 161 37 i3 530 


OUT-OF-SCHOOL PARENT CONFERENCES BY NUMBER AND PERCENT FOR 
CHILDREN GIVEN PSYCHOLOGICAL TESTING AND ASSISTANCE IN 
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TABLE VIII 


TWENTY-EIGHT ELEMENTARY SCHOOLS OF COLUMBUS, OHIO 


——— 


School Number Tested 


Number of Parent Conferences 


Percent of Parent Conferences 


A 20 5 25.00 
B 11 T7 63. 63 
с 7 2 28.57 
р 8 0 0.0 
Е 23 12 52.17 
Е 33 3 9. 09 
а 9 3 33. 34 
H 12 5 8.33 
I 21 1 3.70 
3 6 0 0.0 
" а 1 т. 69 
о 28 5 17.86 
м i 1 100. 00 
11.11 
N 9 1 
3 13.04 
о 23 
46. 12 
Р 13 6 
1 6. 25 
о 16 
3 60. 00 
R 5 
26.08 
S 23 ш 
26.82 
Ф 4i п 
28.57 
U T " 
14.28 
2 у 
У 14 
2 3.12 
У 32 
1 4.35 
х 23 
3 20. 00 
Y 15 
0 0.0 
2 27 
6 50. 00 
АА 14 
0 0.0 
BB 13 
31 18.72 
Office 4 T 
129 


Total 520 


129 
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TABLE IX 


REQUESTED BUT UNABLE TO TEST BECAUSE OF LACK OF TIME 


School Ability Behavior Adjustment Medical Special Class Total 
A 1 1 1 3 
B 0 
с 1 1 
D 0 
E 11 5 2 18 
F 1 1 2 
G 9 1 10 
H 5 2 3 10 
1 6 3 1 9 19 
J 3 3 
K 1 1 
L ў 1 2 
м 1 1 
N 11 P 

1 12 
о 1 
1 2 
Р 1 ii 1 қ 
ж 0 
в i 3 4 
5 4 2 А 
T 9 1 
10 
U 1 i 
у 1 1 " 
Ww 1 i 
х 22 2 1 1 
26 
2 
У 2 4 
РА 1 í 
AA 2 1 à 
3 2 
BB 3 УУ _2 - 1 6 
Total 95 13 17 10 
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from the top quartile group at the average ability 
level and 19 tests for the lowest quartile group. 


Elementary Guidance 


_ The elementary guidance program was primar- 
ily a part of the elementary classroom curricu- 
lum. There was a consistent efforton the part of 
School personnel to use theteam approach in help- 
ing the child solve or adjust to his difficulties. 
The child's family, teacher, and principal were 
integral parts of the team. The psychologist fre- 
quently participated in a team discussion concern- 
ing the child's difficulties. Such conferences 
Were usually held after school so the teacher 
might be present and the working parent would not 
need to be absent from his em ployment for long. 
The length of the parent co nference varied ac- 
cording to the child's difficulties and the under- 
Standing of those concerned in being able to chart 
COrrective measures. Conferences Were usually 
ап hour in length, occasionallylonger. Since this 
Was an after-school responsibility, it was felt a 
more successful conference couldbe held in are- 
laxed, unhurried manner. 

Table VIII shows the number 0 
Parent conferences and compares them 25 a per- 
Cent with the number of children т each school 
given psychological testing and assistance. | 

A | пите between the high andlowachieve- 


Ment schools indicated there were more than dou- 
onferences con- 


ble (32) the out-of-school parent conte: 
cerning children from the top quartile group. 
here were fourteen for the lowest quartile group. 
There were 182 calendar school days for the 
Year 1959-1960, There were 129 out-of-sc hoo 
Conferences with parents. 
Table IX ee the major area of gome 
for children who could not be tested because о 


fout-of-school 


lack of time. This 151 referrals co m pares with 
the 142 who could not receive psychological as- 
sistance during the preceding school year for the 
same reason. Had all requests received psycho- 
logical assistance, the area for Ability Testing 
would have been appreciably greater in Table IV. 

There is a similar comparison for each school 
between the number of children receiving psycho- 
logical testing and assistance for the 1959-1960 
school year and previous school years. 


Summary 


Boys were more frequently referred for psy- 
chological assistance than girls. 

An average three and one-half percent of the 
children in these twenty-eight elementary schools 
received psychological assistance. 

Approximately three-fifths of those receiving 
assistance were over-age for the grade. 

Most children had more than one major area of 
difficulty before being seen by the psychologist. 
Twenty-nine percent were continuing difficulties 
for more than two years duration. 

Grade 1 seemed to need most assistance in 
schools of high academic achievement. Gr ade 6 
needed most services in schools of alow achieve - 
ment level. 

Children of average intelligence were mos t 
frequently referred for psychological assistance. 

The demand for psychological services in- 
creased as the I. Q. range of the childrenlowered. 

More than twice as many out-of-school parent 
conferences were held for children from the high 
academic achievement schools as for those from 
the low achieving schools. 

The requests for assistance were greater than 
the amount of time available for such services, 
even though the psychologist's days werelengthen- 
ed beyond those of the average classroom teacher. 
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GALVANIC SKIN RESPO NSES DURING 
PROBLEM SOLVING 


FRANK W. BANGHART 
University of Virginia 


THE RELATIVELY low correlation (.40to .60) 
between intelligence and achievement suggests 
that systematic research in other areas is appro- 
priate. 

This exploratory study was ап attempt to in- 
vestigate the possible relationships between phys- 
iological responses (as inferred from GSRs) and 
Certain specified variables, i-€-» interest, intel- 
gence, anxiety, academic grades, and group- 

ng. 


Background 
. The role of the autonomic nervous system, and 
in particular, the activity show? рт ни 
In galvanic skin resistance, haslong been ея 
nized asan integral factor in the emotional func- 
tioning of the organism. The ANS, ав 6001 ains 
aumulus effects a change in 
indi en to return the SyS 
ttf, et al. (22) specify thà 
lag the ANS which a з 
А тепіѕ t the i 
Junction wih тааси тінен regulate behavior. 
пш eT (17) discusses ше е: 
is re of thegalvanic skin der mt n After 
ты vascular and sweat-gland "Пе. 
fact iai studies by ide Т 
ismis 

Bol ii ig hE 21805) that GSR 15 Ll eed 
Connected to sweat-gland function а5 a presec 
d activity. Darrow’s early hypoth es ng actual 
S е increased secretory activity chem nervous 
acting, triggered by the sympatia “akin re- 
аеш, was associated with the emo 
Е тысе known as GSR. a ma the 

nce serves as an index ^... d 
A Organism, by ‘showing the activity нон 

* ~ system. 

e € pathways use 
Clearly understood. McCleary ar еттойВ 


ing con ^ 

clusion: The sympathet e the 

«g the Post- gang Ноте a paein ie GSR 
inal pathway’? of the GSR- wnet^ 


*This : м 
Study was made ssible bY ^ 
*Search, Contract Number NONR 474 (8) 


pathway crosses the spinal column is still being 
debated; McCleary reports research (17) which 
indicates that it does. 

The polygraphic technique known 
the “Не detector”, has received ie кик ы з 
not all of which has been favorable. However, this 
technique is based upon the familiar hypothesis 
that changes in emotion, especially suppressed 
fear, appearin a physiological manner and can be 
detected by the use of a polygraph. This instru- 
ment measures, in addition to the GSR, heart rate 
blood pressure, respiration, and, in some cases, 
muscular tension. For an excellent description of 
this instrument and the polygraphic technique, the 
reader is referred to Lee (16). 

Most police investigators prefer breathing and 
blood pressure to the GSR as indices of tension 
because they feel that the GSR is too sensitive a 
measure. However, Jost (8) r e ports that this is 
true only when too strong a stimulus is used; un- 
der more subtle stimuli the GSR may point up re- 
actions which would be lost on a grosser measure- 
ment. Thus, the GSR, if handled properly, can 
be especially valuable to research, since it is 
capable of very delicate measurement. 

Jost gives an excellent picture of the ANS and 
polygraphic techniques inresearch. He comments 
that since the polygraph measures the activities 
of the ANS as manifested in heart rate, muscular 
tension, blood pressure, respiration, and skin re- 
sistance, and the ANS plays an important role in 
the adjustment of the individual to a situation, the 
polygraphic technique can be used to measure and 
record the adjustment of the individual to his en- 
vironment, and env ironmental stimuli. In this 
case, the actual degree of fluctuation is not пеаг!: 
so important as the pattern which is produced у 

The relationship between emotion and an in 
crease in activation as shown by a rise in skin cone 
ductance, is described by Schlosberg (23). Hed 3 
scribes his work in charting an “emotion solid,” 
similar tothe Munsell color solid. The itema: 1 
a series of pictures, arranged on two de 
pleasant-un pleasantness, and Пе 


the Group Psychology Branch, Office of Naval 
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suggeststhat a third dimension, which 
и wee рг variations which are irrecon- 
ciable in a two-dimensional figure, and which 
would correspond to the axis of brightness in the 
Munsell solid, could be an axis based upon the 
level of activation of the picture's subject, as 
shown by the GSR, from sleep to tension. 

Since the GSR gives such an excellent index to 
the emotionalinvolvement of the individual, much 
research has been done with various psychologi- 
cal tests and their impact onthe organism. Levy 
(15) took the GSRs of subjects during the presen- 
tation of the Rorschach test. By presenting the 
cards, not in the customary manner, but rotated, 
she hoped to be ableto find if any of the cards had 
а particular *'affective tone’’ which caused а great- 
er response than the others. Inthe group of 
normals which she used, she found that the GSRs 
to the cards varied with the individual; however, 
there was no particular card or group of cards 
Which seemed to elicit a greater response from 
the group asa whole. Hugh et al., (7) ran a sim- 
ilar test to determine if there Was a greater re- 
5ропзе to color thanto non-color cards. He could 
find **no appreciable variation’? between responses 
on the color cards as a group and the non-color 
cards, as measured by the GSR. In reporting an- 
other phase of the same Study, Jost and Epstein 
(9) point out the adjustment which takes place in 
the test situation. At first the GSRs were high 
and the period of recovery back to base read ing 
quite long. As the subject became adjusted to the 
testing situation, his responses and the necessary 
recovery time decreased. А Similar pattern of 
adaptation is shown inthe study by Martin (20) who 
found that the GSRs of twent y subjects tended to 
decrease for each session of five successive in- 
terviews, showing the carry-over of this adapta- 
tion from one period of time to another. 

Schwartz (25) reports a study on the effects of 
the Picture Frustration Study inthe Galvanic Skin 
Resistance. It is interesting to note that certain 
items which, on the basis of our culture, might 
theoretically be highly-charged situations (namely, 
lying and unfaithfulness) receive avery high mean 
deflection fromthe twenty students taking the test, 
Since this test isone in which the Subject is asked 
to project himself into the situation, the GSRs in- 

dicated here apparently show graphically the de- 
gree of involvement inthe frustr ating situation 
which the individual is able to achieve. 

Inaneffort to detect malingering, and the rea- 
sons therefore, on the MMPI, Cofer et al., (2) 
record the GSRs for a number of testees, In later 
interviews the subjects were asked to explain their 
reactions to items on Whichthey had shown a very 
large or a very slight deflection. No correlation 
was found between high GSRs and an item of зег- 
ious impact to the testee. Contradictory as this 
may seem in the light of research reported else- 

where іп this paper, this study seems to have 


validity. It may be possible that the GSR serves 
as a better index to the subject's response to an 
item on a personality test than does his answer in 
a subjective interview. 

Herr and Kobler (5, 6) report two experiments 
in which the reactions of normals and neurotics 
on a word association test were com pared with 
their GSRs. The variations for the neurotic group 
between the mean GSRs of the words are signifi- 
cantly greater than for the normals. Herr and 
Kobler feel that by analyzing a person’s GSR pat- 
tern made during such a test, and noting the ratio 
of his responses to each othe r, an index can be 
made which would distinguish the neurotic from 
the normal. Paintal (21) reports a study of 450 
psychotics and 450 normals. Taking the GSRs of 
each of these subj ects, when subjected to shock 
and threat of shock, he found that although the 
physiological mechanism which produced the GSR 
is not impaired in the psychotic, there was mark- 
edly less response in this group than there was 1n 
the control group. 

In 1949, McCleary and Lazarus (18) reported 
the use of the GSR to determine thesublimina 
perception of nonsense syllables. Their study 
Shows that although the s ubjects could not con- 
Sciously identify the Syllable which was flashed 
tachistoscopically at a high Speed, he was able p^ 
identify it Subliminally (as shown by his GSR) if i 
presented a threat of shock to him. In this same 
area, McGinnies (19) describes astudy using emo- 
tionally toned and neutral words, The GSR h^ 
measured for the short period before the sub)et 
recognized and reported the word. For the gi 
ical words the GSR was significantly higher. те, 
Stimulus words, McGinnies believes, are clues Wa 
deeply imbedded anxiety which, as a part of 0 
reaction of the ANS, can ђе measured by the £2. 
vanic skin response. To avoid further anxiety t! 
Subject attempts to av 
this effort, inturn, m 
more pronounced, 

The GSR has 
ment of гезеагс 
Wright Ai 
SOn Air F 
(1, 12, 13, 


5 
oid recognizing the SEP n. 
akes the GSR deflection € 


been used recently, as an емін 
В atthe Aero Medical тарата, 
r Development Center, Wri ght- Patt^ b 
orce Base, Here Levy, Burch et at- 
14,22) have done re search on the P с“ 
terns ofthe non-specific responses in skin солдо” 
tance, as a possible clue to monitoring the cele 
Sclousness of satellite and other space La 
crews. Although the onset of sleep cannot be "ise 
mediately determined from the GSR alone, the 
In skin resistance produced by sleep presen, 
pattern characteristic enough to be readily ret 
liable, once this state is attained. Since it re- 
d that the frequency of non-specific 
Sponses is inversely correlated with the ned 
arousal, the various states of arousal can be gal; 
termined, for 4 Particular individual. ATOU” pe 
Participation апа awareness of the environment те“ 
all considered as factors in consciousness; th? 
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fore, the GSR can be used to measure the con- 
Sciousness of the individual. 

The pattern of responses from a signature" 
of the individual whichthese investigators consid- 
er to be indicative of his personality. Levy et al., 
(12) describes three types of patterns. One be- 
longstothehypo-responsive individual. The GSR 
Write-out is flat and relatively low, indicating that 
this is a person who maintains a high degree of 
tension at most times. Оп the other end of the 
Scale is the individual whose record shows 2 great 
dealof fluctuation. Thisis the hyper-responsive 
individual, who relaxes easily, causing frequent 
rises in GSR, then brings himself to attention, 
Causing a lowering, as he faces а change of en- 
vironment, The normo-responsive group show 
some fluctuations in their GSR record, but they 
are not so extreme or so frequent as the hypo- 
responsive group. 

Duffy and Lacey demonstrate d, i 
the pattern mentioned in connection with the hypo- 
responsive group is connected, in some cases, 
with beginning a new task. Thoy found а cl 
toothed pattern'' appearing when their = 
were *'alerted for a psychophysical task". 15 
initial rise was compensated for 25 5007 as the in- 
dividual became accustomed to his task. — — 

The Wright-Patterson investigators pu = 
the GSR shows periods of sleep by rise of тени 
Skin resistance, and periods of arousal ћи i 
ering of the resistance. Relaxation and eed 
ness are marked by a gradually rising пп уђе sub- 
With fluctuations, as stimuli impinge Оп 


Ject. А 
Therefore, the conclusion might be вна 
the more a subject is involvedin his gen esist- 
the lower and less variable will be his skin Г 
ance, i es 
Lacey et al., (10) discuss the gieren kne 
Of response patterns possible, БОН uem Some 
Various types of autonomic жанны ase, what- 
people follow a specific patter . ae tl uctuate 
ever the stress; another group ШАУ лег use 
Sreatly from stress 10 stress; sh ther. From 
first one pattern of responses, then м әкетті toa 
individual to individual, then, the ау. 
Particular stress or situation may Vary P a ie 
An increase in level of а [гот three 
У polygraphic means, тау come a onment, the 
actors: stimulation from the 6n оп to take 
Occurrence of an idea, OF preparé а Hunt (11) 
Some sort of action (23). Тала c is associ- 
Verify this when they say that the GS Pas ai ui 
ated with subjective tension — another " Y 
Ing “level of activation" "- 


Subjects 


in 1946, that 


wo under- 
eriment. 
stra- 


ЗЕ 

The subjects consisted of eit 
Sraduates who volunteered for ep admini 
е general procedure involve 


tion of the Taylor Anxiety Scale, Wonderlic Test 
and the California Occupational Interest Inventory 
Immediately following the testing session the 
subjects were run through the experimental pro- 
cedure in an ABAB sequence (i.e., a group (A) 
non-group (B) basis). 


Apparatus 


The instrumentation usedin these experiments 
consisted of a Hunter Cardmaster, a Wheatstone 
bridge, a General Radio type 715-A direct current 
amplifier, and an Esterline- Angus 5 milliampere 
graphic recorder. As indicated in Figure 1, a 
stimulus is provided to the subject by a Hunter 
Cardmaster model 340. By means of finger elec- 
trodes, a battery, andacapacitively coupled 
Wheatstone bridge, the change of galvanic skin re- 
sponse is detected and then fed into the General 
Radio DC amplifier which affords sufficient ampli- 
fication to drive the Esterline-Angus Recorder. 

The Hunter Cardmaster was loaded with 37 35 
x 6i inch plastic stimulus cards. This mechanism, 
as utilized, enabled the subject to view the stim- 
ulus cards individually at any rate or duration 
which he desired. This control of stimulus was 
effected by operation of a pushbutton held in the 
subject's left hand. 

Finger electrodes were connected to the right 
hand on the tips of the first and fourth fingers. 
Electrical contact was assured by coating the fin- 
gers and the electrodes with Sanborn Radux paste 
and by strapping the electrodes tothe fingers with 
a firm pressure. The electrodes were connected 
to the Wheatstone bridge, as was the 7,5 volt bat- 
tery, and the bridge output was capacitively 
coupled to the GR DC amplifier through a . 043 
microfarad Vitamin Qcondenser. This condenser 
and the input circuit formed a frequency selective 
filter with a time constant of a half second. Thus 
only variations of galvanic skin response with а 
fundamental f r equ ency of 2 cps or greater were 
recorded. The circuit employed is shown in Fig- 
ure 2. 

The General Radio DC amplifier is a three 
stage unit having a sensitivity of 100 millivolts in- 
put for a full-scale 5 milliamperes output. The 
unit is stable and calibrated, permitting accurate 
measurement of dermal resistance at any given 
time. The high frequency response of the ampli- 
fier was foundto be considerably above that of th 
Esterline-Angus graphic recorder tracking ca s. 
bility. Thus changes in GSR above 15 cycles г? * 
second were not detected by this system. ius 
а. 

I pacitive coupling, the 
equipment was used to detect only those vantati 
of GSR within the fundamental range of 1-15 etis 
Very gradual changes, or variations whos wo 
acteristics were under 1 cps, were not E 
Thus the measuring apparatus was sensitive only 
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FIGURE 5 
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FIGURE 7 
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to the frequency and amplitude variations within 
the specified limits and thereby retrieved infor- 
mation characterizing rate of division of change 
of galvanic skin response at any given time. By 
this means baseline drift was eliminated but only 
at the expense of measuring dermal resistance on 
an absolute scale. 


mean galvanic skin re- 


Figure 3 displays the 
of Interest Scale of the 


sponse scores onthe level 
California Occupational Interest Inventory. The 
GSR reaction intensity is represented onthe y axis 
and the time sequence on the x axis. The num- 
bers on the x axis denote stimulus cards. The 
first three cards were used as *twarm-up and 
therefore are not includedinthe analysis of data. 

Figure 3 illustrates a rea 50 nably consistent 
higher intensity in GSR reactions on the part of 
the higher interest level group. This is of espe- 
cial interest if one recalls that the Occupational 
Interest Inventory level of interest scale 15 fund- 
amentally a measure of theoretical [мелен -a 

Figure 4 illustrates the mean galvanic Br Ss 
sponse scores for subjects above and be Booms 
median on the Wonderlic Personnel Test (а £ 
index of mental ability). Қ 

The data in Meuse d are consistent ipu а 
displayed in Figure 3. This would seem cerned 
cate that the level of interest scale 8 pee irm 
with theoretical interests only- Ho oes 
ation of Figures Запа 4, there seems A theoretical 
gestion that the higher intelligence ап iological 
interests are associated with baie phys! 
activity as reflected in GSR reactions: responses 

Figure 5 illustrates the galvanic Se ing prob- 
of subjects during the pro cess 0 nother per- 
lems with and without the prese 
son. The experimental set-UP Emi 
ond person in the two person prec That is, 
*tdecoy"' rather than serve as Е Бай to agree with 
the second person was and disagree on 
the subjecton certain problem d out in а попѕуѕ- 
others. The routine was carrie 
tematic manner. 

The graph in Figure 
one would expec 
stances. That is, 


es pasically what 
i f circum- 
he given set о d 

-ects showed а consid- 
he quen esence and be- 
ction arently became ac- 
It is apparent from 
get nearer and 


5 illustrat 


havior 
climated to t 
Figure 5 that the G 
nearer toget 


anxiety. 
e be due to the fact thal 
for subjects on the 


rather heavily aboutthe median. If one used only 
extreme scores, different results might occur. 
In the present study the median Taylor score was 
equal to thirteen and the range extended from one 
to thirty-two. 

Figure 7 illustrates the mean galvanic skin re- 
sponse scores for subjects grouped above and be- 
low the median on the basis of their overall aca- 
demic grade average. 

Figure " seems to be of ins pectional interest 
only. The disparity between above and below me- 
dian groups does not appear to be significant. The 
relatively consistent superiority oftheabove me- 
dian group is suggestive, however, and possibly 
indicates some kind oftrend. There was very 
little difference between the grades of the two 
groups, with a heavy cluster about the median. 
Therefore, the relatively small but consistent su- 
periority of the above median group, coupled with 
the results of above median groups with reference 
to interests and intelligence, suggests that further 
study in this area might be profitable. 


Summary 
BUB T 


This study explored the possible r elationship 
between galvanic skin responses andinterests, in- 
telligence, grouping, anxiety and grades. Definite 
trends seem to be indicated in regard to interests, 
intelligence, and grouping. № real trends are 
indicated in regard to anxiety and grades. 
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IF SCHOOLING is to be improved in a system- 
atic fashion, itisfirstnecessarytodevise a means 
for appraising the learnings of individual students. 
This appraisal can of course be accomplished a 
part at the present time. The development о 
modern standardized achievement tests has made 
it possible to measure the progress ofa stude ni 
toward those educational goals which are define 
mainly in terms of the acquisition of knowledge 
and skill. There are other objectives, however, 
which cannot be measured by standard ac hieve- 
ment tests, but which are still cons idered vital. 
For example, it is commonly hoped that schooling 
will help a youngster to acquirea realistic aware- 
ness of his own capabilities and limitations, but 
it is usually difficult to determine the extent to 
which this awareness has been achieved. Thelack 
of a generally accepted definition of ‘‘realistic a- 
wareness” does not make the objective seem апу 
less important to teachers and the citizenry at 
large, nor does it seem likely that it will be a- 
bandoned. The problem facing educators, pa 
is to find a means of defining and observing Ея 
behavior signified by this and other similarly ne 


ulous terms. | 5 
i en useful in area 
A procedure which has prov d oris AUN) @- 


of applied psychology is Steve | 
сао, It is a special method of presenting 


een 
test items and analyzing the ИИ 
er а EE atti tudes and beliefs. 


and in the measurement of 

Q-technique would appear to offer i = E sde 

means of dealing more qose rere у у panem 
i i s, andi 

of their evaluation problem ДО ы топа ө aa 


of this paper to present some i 
the poles it сап be used with groups of students. 


mples will be given. There will | bea 
eri са а of some of the problems which a- 
rise when Q-technique is used in the classroom. 
Some comments will be made about how the con- 
cepts of reliability and validity might be applied 


to Q-technique. 


Example One: The Measurement of Personal Ad- 
justment 


The first study was undertaken todetermine 
whether or not the twelfth grade students enrolled 
in a particular senior problems course increased 
in personal adjustment to a greater degree thana 
group of similar students who were not enrolled 
їп the course. The index of adjustment used in 
this study was based on a correlation coefficient 
which was completed by comparing a student's Q 
sort description of his ‘‘ideal self" the person 
he would like to be—and his ‘‘perceived self'"— 
his real or everyday self, again as described by 
the Q sort. Following Rogers (1951) and others, 
a high correlation between the perceived self and 
the ideal was taken as a sign of self-acceptance 
and personal adjustment. Conversely, a student 
who saw himself as being quite differentfrom his 
ideal—the person he would like to be— was re- 
garded as less well adjusted. 

The first step in the study consisted of collect- 
ing an appropriate group of descriptivestate- 
ments. To this end the students in several senior 
problems classes were askedto complete a num- 
ber of unfinished sentences such as “Му person- 
ality Strengths are..."'; “Тһе ideal job ѕһоша, 27; 
“Good parents should...” Sixty self-descriptive 
statements were then written by the investigator, 
in consultation with the instructor of the senior 
problems course. Each statement r elated to an 
aspect of personal adjustment as the teacher em- 
ployed that concept in the course, but was written 
in the idiom of the students, as revealed by their 
completions of the open-ended sentences. Care 
was taken to avoid ambiguity and to develop state- 
ments which were independent of one another. 
Each of the sixty statements was printed on a 
small numbered card, to permit easy sorting by 
the students. A set of cards was prepared for 
each student in the sample. 

Three classes in senior problems, 67 pupils 
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the same teacher, constituted the ex- 
ее А fourth class of 33 firstse- 
mester seniors became the control group. 
During the first week of the spring semester, 
each student sompleted ‘‘Self-Sort I", Each was 
given a set of statement cards, à record Sheet on 
which to indicate the ‘‘score’’ assigned to a given 
statement, and a typed copy of directions. They 
were instructed to sort the statements into nine 
ranks in the way that best described themselves, 
and to assign a score to eachstatement according 
to its rank. The highest scores were assigned to 
the most descriptive; i. e., the highest ranking 
statements and the lowest score to those least 
descriptive. The range of scores (ranks) was 0 
through 8. By specifying the number of state- 
ments to be given a particular scores—thatis,as- 
signed to that particular rank— the statem ents 
were forced into a quasi-normal distribution as 
shown in Table I. The students then recorded the 
score for each statement on the record sheet. 
Two to four days later, the students completed 
“Ideal-Sort I", describing the person they would 
mostlike to be. At the end of the — Eee 
repeated these two "UM completing ‘‘Self-Sort 
pe n -Sort ПП”. 
" euni oe coefficients of с t 
tion were computed for each student, ped ееп 
Self-Sort I and Ideal-Sort I, and the [^ ud Бы 
tween Self-Sort II ann PH coe ees 
ead pues ed ect each о Po ow. 
ifferent occasions.) This was Я 
ор since the only, со р Е 
ве! путни арени and summing 
Pen deos The correlation was then read from 
Me vieni alert The record sheet was arranged 
a рее apid comparison of scores and, by use 
~ arm лоб, any given Se ен 
a i an B 
relation eonig = т converted to 
и а aan we correlation between Self- 
Eee eig -Sort I was subtracted from the 
sort] and Taea eee gelf-Surt I and Ideal-Sort Ш. 
сук pte D S TEEN as the index of change in 
Tha ан, higher a positive difference, the 
o UR EE change in self-acceptance. 
emet distesence presumably indicated that a 
a eicere less self-accepting, less well adjust- 
~ de the beginning of the course. | 
ей, Бак an differences of the individual experi- 
Tuer s, and of the total experimental 
mental classem ared with the mean difference of 
group жете и The significance of the differ- 
the control Sateen and the results are presented 
enpe eo ae shows how and in what direction 
in Table IL, У ed during the experimental peri- 
each group ege en that, at the beginning, the 
gd. Tt will be 5 appeared to be better adjusted, 
control classes nd, they hadlost ground inthis 
put that at the ene» 


respect. 

On the other hand, theexperimental group was 
lower at the beginning, but made some slight 
gains. These findings lead to the question of whe- 
ther in our culture а decline in sel f-acceptance 
does in fact occur during the high school years. 
Does the imminent necessity for making impor- 
tant educational and vocational decisions produce 


а l'ack of Security and self-assurance? Or are 
Students acquiri 


ideal person wh 
themselves? О 
tigate these and 

Table III sho 
the coefficients 
and Self-Sort II 


Stant, even when 


three exper 
nificantly at the , 


05 level of со fid E 
results are inconclusi nlidence, These 
Senior problems Shee рш виввеві eo тв 


ing its goal in the цы? Dot have been achiev- 


h 
ed to sor YPothesizeq 
public schoo] curriculum, aden а ut + 
show a preference for а “subject rators Would 
riculum, and teachers woulq Sho Сегед» Cur- 
Eor а qiludlent-centered curriculum, P'eference 
a firs step, the i 

dent to list the four most СОг asked each tu 

pus by pupils in the зесопа pec Vities en 
vities w us oyed. е resulti iste ool where 

ambin 88 examined, duplications ^5. 20 acti 
mbiguities Clarified. т uos elt ated, апд 

" St mag 
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| 
| TABLEI 


FREQUENCY DISTRIBUTION FOR THE 
SENIOR PROBLEMS SORT 


Least Like 

S 
Score 876 5 4 3210 

1 Frequency {147 11 14 1 141 (п = 60) 

© 

|| 

"А 

[^ 

|| 

LÀ 

| TABLE II 


RS OF CORRELATION COEFFICIENTS BETWEEN 
У NDARD Е ORTI, AND SELF-SORT Ш AND IDEAL-SORT II 
SELF-SORT 1 M TWO GROUPS OF HIGH SCHOOL STUDENTS 


Ея: 


MEANS AND STANDARD ERRO 


N Correlation I Correlation II 
Mean Sm Mean Sm 
| _ м SEE 
Control Group 37 612 .048 .562 .065 
Experimental I 21 570 074 .591 077 
Experimental II 22 520 . 080 610 071 
Experimental III 24 526 058 .614 076 
67 .538 .038 . 616 . 042 


Total Experimental 


(The correlations have been converted to Fisher z coefficients). 


JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE III 


DISTRIBUTION OF CORRELATIONS B TWE 
SELF-SORT I AND SELF- SORT i ЕН 


= 02 


Correlation 


Frequency 
= 
.10-.19 А 
.20-.29 Р 
30 - .39 4 
40 - .49 5 
.50 - .59 T 
60 - .69 T 
70 - .79 їй 
„8 —.89 8 
TABLE IV 
RATIOS BETWEEN THE MEANS ON THE MEASURE ; 
THE CONTROL AND THE EXPERIMENT AL GRO USTMENT FOR 
UT Before ik аа 
trol with: =o er Measur 
Contr t Ratio Sig. Ratio б p Riferences 
у tRatio о 
Sig. 
Experimental I . 580 "B .287 r Ый 
Р * 
Experimental IT . 988 * . 500 ж bon 
-882 
Experimental ПІ 1.138 Ж 2521 " | * 
- 858 


Total Experimental 1.213 * Ju . 


ж 
1.984 " 
+ 05 
* Not statistically significant. 
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up a ‘‘parent’’ population of items. Drawing up- 
on this list, the instructor then constructed thirty 
statements representative of a subject-centered 
curriculum, and thirty statements representative 
of a student-centered curriculum. Exemplifying 
subject-centered activities were: 1. studying the 
U. S. constitution, 2. studying geometry, 3. 
Studying Latin. Among the student-centered ac- 
tivities were: 1. vocational guidance, 2. teaching 
communication skills, 3. learning to keep healthy. 

Each of the graduate students was then in- 
Structed to sort the cards into a forced distribu- 
tion as described in the first example. He as- 
signed high scores to the activities he considered 
most important and low scores to those he con- 
Sidered least important. After sorting, he re- 
corded a score (rank) for each item on the record 
form. This record form was so arranged that the 
instructor could independently total the scores as- 
signed to student-centered items, and those as- 
signed to subject-centered items. Thus he could 
quickly determine whether a student should be 
categorized as basically subject-centered or stu- 
dent-centered. 

Since the N and the distribution were known 
and were the same for all sortings, the magnitude 
of difference to produce a criticalratio indica- 
tive to statistical significance could be calculated 
before administration of the items. 

Intercorrelations of the sortings were comput- 
ed for the five administrators and the fifteen 
teachers in the class. Theresulting matrix 
showed that the administrators did not correlate 
any higher with each other than with the teachers. 
Thus the major hypothesis of this study was not 
supported. 


Example Three: An Investigation in Educational 
Philosophy 


Although this study was not completed, де 
trates how Q-techniques might be used Күр. on 
data regarding changes in a student's електе nd 
of education during a course, and data sugg 


of the instructor's influence. 


i it was neces Sary 
For purposes of this study, z Ee вене“ 


that the investigator prepare а п “i 
statements representing each of ше Leser it 
cal positions: realism, idealism, ап а T 
Each statement had to be mutually exc eme "xi 
had to characterize one ot the thr ee e on oat 
not the other two. A second чиде ин. 
onto this group of items, s cura T ih eare 
That is to.say, statements which e Aaa 

hysics, epistemology, orlogic were categori: | 
iy itive. Statements which dealt with axiol- 
E c or esthetics were classed as affective 
dm Adding this second келтіре деш er. 
1 . И d às 

ix di ategories of items (and an eq 
Sx pepe had to be prepared: cognitive-re- 
зне affective-realistic, cognitive-idealistic, 

, 


affective-idealistic, cognitive-pragmatic, affec- 
tive-pragmatic. 

Because the boundaries between these philo- 
Sophical positions are not clearly defined and 
generally agreed upon, the [011 owing steps were 
taken to secure items which would possess con- 
tent validity. First, the investigator selected 
from the writings of philosophers and from text 
books in the philosophy of educ ation, approxi- 
mately 100 statements which appeared to repre- 
sent one of the three philosophical positions but 
not the other two. These statements were listed 
in random order, copies of thelist were prepared 
and given to five professors of philos ophy, who 
had agreed to participate in the p roject. Each 
professor went through the list and independently 
marked each item to indicate which of the philo- 
sophical positions he believed it represented. А 
*fcannot say” category was permitted where the 
professor found an item difficult to classify on 
any dimension. After computing the results of 
five such validations, the twelve most appropri- 
ate items were selected to represent each of the 
Six categories. No item was used if it had been 
classified by any one of the professors as repre- 
sentative of more than one category оп апу dimen- 
sion. Some of the items used, however, were a- 
greed on by three or four professors, but placed 
in the ‘‘cannot say’’ category by the others. Thus 
a sample of 72 discriminating items was selected. 

И this validated sample of propositions from 
philosophy were to be sorted by each student at 
the beginning of a course, say in the philosophy of 
education, and again at the end of the semester, 
number of important questions about the progress 
of the student in the course could be answered by 
following the procedures suggested below. 

1. An analysis of variance of each student's 
scores would reveal (a) whether or not he held а 
consistent philosophical position (atleast with re- 
spect to the statements provided for him to sort), 
(b) which of the three positions he favored, (c) 
whether his preferences were essentially for the 
cognitive, the affective, or both. 

2. A correlation of the initial and final sort- 
ing would provide an index to the extent of change 
in the student's philosophy. The higher the cor- 
relation, the less the change. 

3. Either or both of the student’s sortings 
could be correlated with а sorting made by the in- 
Structor. 1f, for example, the final student-in- 
Structor correlation were significantly greater 
than the initial one, it would be evidence that the 
student's educational philosophy had moved closer 
to that of the instructor. 


Example Four: Q- Techniques as an Instructional 
Tool 


In this study, role-playing interviews were 
used as an instructional device in a counselin g 
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seminar. Q-technique was used to evaluate how 
well the counselor role was played. Forty des- 
criptive statements were collected that could be 
used to describe both good and bad aspects of a 
counseling interview. Many of the statements 
were taken from Fiedler (1953) and reworded for 
application to a counseling situation. Atthe be- 
ginning of the class period, before the role-play- 
ing began, all students and the two attending fac- 
ulty members were asked to sort the statements 
into the distribution indicated in Table V, to des- 
cribe an ideal interview. The statements Hon. 
characteristic of an ideal interview were assigne 
the highest scores, and thoseleast characteristic 
were assigned the lowest scores. The score for 
each item was then recorded ona record form. 4 
А{їег а го1е-р1ауїп interview had been acte 
out, and before any discussion of it, the qeu toca 
and participants were asked to sort the S e 
gain, this time to describe the pedit. ey s 
just observed. Any observers apprais о е 
mock interview then could be obtained by =. гге- 
lating his Q sort Чевстїрчоп тен ot 
i i ort description of the 1 Е 
Tus А correlation coefficient, the better 
i ing of the mock interview. 
ше тіні device, the use о 
resents many possibilities. Itis d Y - 
ful for making students aware of pean Ed p^ 
tra-observer and inter-observer hes vis пуу of 
the influence of halo effect, and o ү аи е 
of operational definitions for epo К fice 
d interview". For example, t! ны E 
Techni for the systematic appraisa! ot the moc 
пен та roduced a result very differentfrom 
пере p ressions of the obse rvers. In the 
eri e г. one student, the correlation between 
In the = description of a mock interview which 
de ed а “вооа” on a global basis, and his Q 
Шеш она Nom of the *'ideal" interview was 
2. a тын is a dramatic illustration of the 
ia ple validity of the global impression of 
po ie observer and provides one more bit 
of i xin for the case against global observa- 
о: 
а ur increasedthe student's aware- 
Mns significance of operational definitions, 
ym Y^ erri that the two instructors in the 
eem E both professional counselors, one des- 
Е himself as *Rogerian'" in philosophy, the 
фрак “есіесіс”, correlated 76 in describing 
ар interview. (This of course is reminis- 
ы vh of Fiedler's findings). ; 
се When all their sortings were intercorrelated, 
it was found that the students were in much closer 
1 ;reement in describing the ideal interview, an 
Ратне | construct, than in describing an actual 
i ole-playing interview. It is suggested that, as a 
result of having had essentially the Same courses 
and textbooks, they m аш to а 5їегео- 
{уре їп describing the ideal. e relatively ioe 


correlations between their descriptions of the 
real interview suggest that their verbalizations 
relating to counseling were still in the nature of 
rote learning and not yet understood in terms of 
the observable behavior of people. On the other 
hand, the low correlations suggest differences in 
perception, perhaps only some of which could be 
reduced by training— a difference which perhaps 
must be accounted for in terms of deeper psycho- 
logical mechanisms relating to motivation. 


Discussion and Evaluation 
=== зе and Evaluation 


1. Is it feasible to em ploy Q-technique with 
groups of people? It is clear that concepts and 
procedures are being devel Oped by clinical and 
counseling psychologists which, properly applied, 
can be extremely useful to educators in dealing 
with individual students. Since modern educa- 


tors, however, must deal with large numbers of 
Students and, usually limitations in staff and 
budget, the new techniques will be more useful if 
they can be adapted for use with groups. The 
findings described above indic ate that Q-tech- 
nique can be readily and profitably applied to 
groups. In these four studies, once the descrip- 
tive statements had been collected (and of course 
that is the most crucial step in the entire proce- 
dure), sets of items were quickly prepared, using 
standard duplicating processes and apaper cutter, 
and were found to be s atisfactory in both small 
and large classes. It was found that, at the high 
school and college level, the mimeographed in- 
structions for sorting and the recording of scores 
were adequate. At the college level, for example, 
with one page of written directions, only one of 


122 students needed additional i i 
| st 5 
аа [e Instruction. Atthe 


l, when directions were read to 
fne Students, very few of them made errors in 
TE irst sortings, and попе in subsequent sort- 


2. Using the = 
€ scale b 


isthe comparative ease 
To correlate the re- 
60-item Likert-type 
i using 2 


people | 
Scale requires ab on 


А second advantage 975. 
tems that ¢ Уре Scale is the larger number осе 
is consid © Presented, Each forced © 
Mo Squivalentto one item. ree {0 
which an int, t subject to faking? The deg ал pe 
d dependa >t 07 Personality inventory Cs of 
€pends in large part on the obvio" n 
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TABLE V 


FREQUENCY DISTRIBUTION FOR THE COUNSELING SORT 


Most Desirable ~ Least Desirable 


Score 6 5 4 3 2 1 0 


Frequency 2 5 8 10 8 5 2 (n = 40) 


149 


150 JOURNAL OF EXPERIMENTAL EDUCATION 


i i in social acceptability 
ben apr. e mno whether or nota forced- 
enore technique is used. Unlessa person who 
writes the items possesses unusual skill, Б; 
seems doubtful that his Q items will be as subtle 
as empirically derived scales developed by pro- 

i makers. 

m — to social acceptability, however, 
it would appear that Q-technique may ода 
tinct advantages. In many personality inventor- 
ies, the ‘‘adjustment’’ score depends on the num- 
ber of unfavorable characteristics a s yen ү 
willing to admit he possesses. But n 
adjustment, when defined by Rogers andothers in 
terms of self-acceptance, depends on ои 
between the perceived self and the ideal гч f. 
this concept is sound, Q-technique provi les a 
powerful tool indeed. It would take рака ены 
ating апа psychologically qe одани с peers 
perceive that the index of adjustmen з-у по 7 
pend on the self-description, but га er on ре - 
acceptance. Although сеа а Ка 
si eptability inherent i = , 
5 be daal with by those methods сүре = 
cently by Edwards (1957). Sinc i. à ЫЕ me 
sents the subject with a more in p^ volti рек. 
does the usual forced-choice test, 
e. 

— реј level is Q-technique 

4. dins As reported above, ithas boen urea 
ин УУ with high school бабы чал 
ее паге е ае к. level of difficulty, 
it ШЕ шз позвони to believe e cbe n can be 
z rade 5 
A C и denos dire statements come 

» po the first step in writing ше 
from? ive careful thought to the eap en | 
ep мені nted in the Q sort. These will be А 
be represe the questions the investigator wants 
т Once the writer has decided on the 
н f his instrument, then, by asking 
„шеше E. uestions of asample of individuals 
ека іпіепаѕ [0 inves tigate, hecan 
pes Maple of items in the idiom of the sub- 
а 
jects themselyes, ts, ог beliefs under 
1 If ше Репште that the items possess con t e nt 
scrutiny а " the case of the **philosophysort 
онн нр салдың then the writings of the acknow- 
ть та givenfield may be used as a 
edg ] 
и а = аа ане be used to measure change 

б, Сап ee By correlating the sortings 
ae erson on two different occasions, an 
шас ү, им zin find out whether or not change 
oleas d in a subject. If, for example, a sci- 
е ae rent wished to measure the changes in 
poor on ae science which occurred in his 
ame r steps would be involved: 1) The in- 
Жы лі (нені апа directions) would be соп- 
5 


Structed. 2) The instructor would sort the items 
to describe the ideal attitude » the one he would 
want his students to acquire, and would record his 
Sorting on a record form. 3) the students would 
sort the items at the beginning of the course to 
describe his attitude toward science. 4) The stu- 
dent would sort the items at the end of the course 
to describe his attitude. By correlating the stu- 
dent's first sort with the ideal, the instructor 
could determine degree of con gruence. By cor- 


relating the second Sort with the 
Structor could 


This permits classification of 
ms of the variable as Soon as the 
to the items are summed. 

оггејаНопз are to becom puted 
Оп table or graph 
may be constructed. This permits 
а correlation co efficient directly 
mation of the Squared differences 
Scores (ranks) assigned each item of 


the subject in ter 


the sort. 


Summary 
A 


ву as envisioned i 
author, Stephenson (1953). The exp 
these studies, however, re 
conclusions: Q-technique can be a 
intriguing ways to important problems ОЁ educa- 
tional measurement. It is highly feasible to use 
Q-technique with groups of students. Indeed, for 
Some purposes, the technique is more flexible and 
less time-consuming than conventional methods, 


О major 
pplied in many 


1, 


2. 
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THE USEFULNESS OF A TWO-WAY ANALYSIS 
OF WISC SUB-TESTS IN THE DIAGNOSIS 
OF REMEDIAL READING PROBLEMS 


LYNNE SCHELLBERG HIRST 
University of Wisconsin 


THE BASIC purpose ofthis paper is to explore 
the usefulness of a two-way method of analyzing 
the sub-test scaled scores of the Wechsler Intel- 
ligence Scale for Children (V/ISC) in the diagno- 
sis of remedialreading problems, so as to facil- 
itate a more accurate appraisal of intell ectual 
functioning in regard to retardation in reading. 
The second purpose was to note any distinctive 
test patterns in the WISC sub-test scaled scores 
that are characteristic of severely and mildly re- 
tarded readers. 4 р | 

The type of analysis employed in this paper is 
the “scatter analysis", which refers essentially 
to an examination of the sub-test scaled Scores 
or raw scores in relation to the particular mean 


ore that is being used. | 
Е One of the most common methods of analyzing 


the scatter of sub-test scaled scores on the WISC 
is to relatethese scores to the scaled score of 10, 
which is the scaled value assigned to the mean 
raw score for each sub-test іп the standardization 
ofthe test for each age group. Three scaled 
Scores represent a sigma in the distribution of 
raw scores for each age group's sub-tests. How- 
for the purpose of this paper, two scaled 
or the equivalent of two-thirds of a sig- 
e referred to as being significant. To 
study is influenced by the usual 
f accepting this interpretation. 
led scores to the scaled score 
mean of 10 gives the individual's weaknesses and 
strengths in relation to the n уз 

i ethod ignores, ‚ the relat- 
КОН нире ая within the individual 
perse. For example, the majority of the нра 
scores for bright children fall іп the proximity o 
the scaled score of 12, and few of their relative 
weaknesses fall below 8, so that their relative 
weaknesses and strengths are difficult to ascer- 
tain. This is also true in reference to dull chil- 
dren since a high percentage oftheir scaled Scores 
fall close to the scaled score of 8 and few of their 
relative strengths fall above the scaled score ot 
12. Thus, a complete picture of the individual's 
strengths and weaknesses is not presented by this 


method alone. 


ever, 
Scores, 
ma, will b c 
support this, this 
clinical practice о 

Relating the sca. 


А second method of analyzing the scatter of the 
sub-test scaled scores is to relate each of these 
Scores to the individual's own scaled score mean. 
However, the difficulty with this method is that if 
а person with a mean of 5 scored a 7 on a sub-test, 
this scaled score of 7 would be considered signif- 
icantlyhigh. Thus the relationship of the individ- 
ual’s weaknesses and strengths to the scaled 
Score mean of the test’s equivalent standardized 
age group is overlooked. 

While the use of either method of scaled score 
would appear to have particular advantages and 
disadvantages, ifthe two methods of analysis could 
be relatedto eachother, a valuable means of anal- 
ysis of scatter might be provided. 

Miss Ella Bullis ofthe University of Wisconsin 
Reading Clinic has developed a way of analyzing 
the scaled scores that account for both methods. 
On one dimension of her two-way analysis scale 
are the scaled score mean of 10 and the deviations 
{тот this mean so that the relationship of the in- 
dividual's scores to his equivalent age group's 
Scores is taken into account. On the other dimen- 
sion are the individual's own mean and the devia- 
tion scores from it sothat the subject's own weak- 
nesses and strengths are considered. This two- 
way analysis is used in this paper. 


Methodology and Population of the Study 


Thetwo- way analysis employed in this study 
can best be explained by Figure 1 (see top of next 
page). 

Across the top f ro m left to right аге grouped 
three categories of scaled sub-test scores. It is 
assumed that two scaled scores, representing 
two-thirds of a sigma from the mean of 10, isa 
significant deviation from the mean. Thus the 
scaled scores of 9, 10, and 11 are classified in 
the chart as ‘‘average’’; the scaled scores of 12 
or above as ‘‘high’’ and the scaled scores of 8 or 
below as ‘‘low’’. 

The other axis consists of the individual’s mean 
scaled scores. Two scaled scores are likewise 
assumed to representa significant deviation in the 
distribution of scores from the individual’s mean 
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FIGURE 1 


THE TWO-WAY ANALYSIS 


Significant Deviations from the Scaled Score Mean of 1 
n of 10 


High 
124 


Above 


Individual's 
Mean 


a 
Below 


score. 

This two-way method of analyzing sub-test 
scaled scores was employed on thirty remedial 
reading cases from the 1958 and 1959 Summer 
Reading Clinic cases at the University of Wiscon- 
sin. The subjects for this study were selected on 
the following criteria: 1) Their full scale IQ must 
be 89 or above; 2) their reading level as measured 
by the Chicago Silent Reading Test, Form 2, and/ 
or the Gates Advanced Primary test must be six 
months or more below their mental age; 3) their 
chronological age must be between 8-0 and 13-6. 

The mean Verbal Scale IQ for the thirty sub- 
jects was 100.5, the mean Performance IQ was 
111.6, andthe Full Scale IQ was 109.26. The 
eleven point difference between the Verbal and 
Performance Scale IQ's was found not to be sig- 
nificant. The average СА for the group was 10-3, 
and the total range of reading disability for the 
group was found to be from seven months to four 
years and eleven months. 

The group of thirty children was then divided 
according to the degree of reading disability. One 
group consisted of those individuals who had a 
reading disability of two or more years and were 
called the severe reading disability group. The 
second group, called the mild reading disability 
group, consisted of those individuals who had a 
reading disability of less than two years. 

A sample of the two-way analysis m ethodas 
applied to one of the reading cases is shown on 


the following page. 
Results 
The analysis of the results are divided into 


three sections: the total group’s results, the mild 
reading disability group’s (MR’s) results, and the 


severe reading group’ 
г p's (SR’ 
pose of this Section of € 


distinctive 
Sub-test scaled 
hese groups, 


bly sub-tests, 
In respect to those Scores 


-tests as qjq 2181 Span 
ub-test 919 23% of the 


Mild Reading Group’s Result 
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Fifty percent 
viduals whose аре 
two years (Table 
the two-way anal 
pletion and Pictu 


bn MR’s t А 
ility in Pant 15, those indi 
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ysis means or nifleantly whens 


r 
e Arrangement si 
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Individual's Mean 
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SAMPLE OF TWO-WAY ANALYSIS 


Name - P. S. 
CA 9-2 Scaled Score IQ 
Verbal Scale IQ 50 100 
Performance Scale IQ 51 101 
Full Scale IQ 101 101* 
Scaled Score Scatter | 
High Average Low 


Information (15) 
Picture Arrangement 


14) 
Object Assembly (13) 


Comprehension (12) 


Similarities (10) 
Coding (11) 


+. 


Arithmetic (5) 
Vocabulary (8) 
Picture Completion (6) 
Block Design (7) 


*Digit Span omitted 
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ТАВЉЕ 1 ТАВЉЕ П 
THE PERCENTAGE OF THE TOTAL GROUP'S SUB- TEST THE PERCENTAGE OF THE MILD READING DISABILITY 
SCALED SCORES THAT DEVIATE SIGNIFICANTLY GROUP'S SUB- TE 
а ST SCALED SCORES THAT DEVIATED 
ABOVE AND BELOW THE TWO- NALYSIS SCORES SIGNIFICANTLY ABOVE AND BELOW THE TWO-WAY 
- ANALYSIS MEAN 
High Low 
Information 10% 1% 
High Low 
Comprehension 17% 13% 5 
Arithmetic 3% 37% Information 11% 6% 
Similarities 13% 11% Comprehension 22% 17% 
Vocabulary 3% 23% Arithmetic 5% 28% 
Digit Span 0 38%* Similarities 11% 11% 
Picture Completion 50% 10% Vocabulary 5% 17% 
Picture Arrangement 47% 13% Digit Span 0 38%* 
Block Design 23% 13% Picture Completion 56% 11% 
Object Assembly 208; 3% Picture Arrangement 50% 10% 
Coding 13% 37% Block Design 33% 22% 
Object As bl 5% 
*For 21 of the subjects ке са ы ud 
Coding 11% 28%, 


*For 18 of the subjects 


9ST 
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TABLE III 


THE PERCENTAGE OF THE SEVERE READING DISABIL- 
ITY GROUP'S SUB- TEST SCALED SCORES THAT 
DEVIATE SIGNIFICANTLY ABOVE AND BELOW 

THE TWO-WAY ANALYSIS MEAN 


High Low 
Information 8% 8% 
comprehension 8% 8% 
Arithmetic 0 5095 
Similarities 1295 25% 
Vocabulary 0 33% 
Digit Span 0 38%% 
Picture Completion 42% 8% 
Picture Arrangement 42% 8% 
Block Design 82% 0 
Object Assembly 42% 0 
Coding 17% 50% 


*For 9 of the subjects 
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FIGURE 2 


E DIFFERENCES BETWEEN THE THREE 


READING DISABILITY GROUPS 


A GRAPHIC DESCRIPTION OF TH 
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10 Q io Io O 10 O i0 ош сш 
со со че “= ачамзе 


S[enprArpu] jo Э8езиэотэа 


g Disability Group 


Severe Reading Disability Group------....... 


Total Group 
Mild Readin 


22% of this same groupscored significantly above 
the two-way analysis means onthe Comprehension 
sub-test. 

Twenty-eight ofthe MR's deviated significantly 
below the two-way analysis means on the Coding 
and Arithmetic. 

Onthe Block Design sub-test, approximately 
the same percentage of individuals deviated sig- 
nificantly above as they did below the two-way an- 
alysis means. Noticeable, also, was that on the 
Object Assembly sub-test very few individuals de- 
viated above or below the two-way analysis means. 


Severe Reading Disability Group’s Results 


Forty-two percent of the SR’s, that is, those 
individuals with a reading disability of two or 
more years, scored significantly above the two- 
way analysis means on the Picture Completion, 
Object Assembly, and Picture Arrangement sub- 
test, respectively. The percentage of individuals 
who scored significantly above the two-way anal- 
ysis means is surprising in view of the fact that 
most of the mild reading disability cases scaled 
scores did not deviate from these means on this 
sub-test (Table Ш). -— 

Fifty percentofthis group scored significantly 
below the two-way analysis means on the Arith- 
metic and Coding sub-tests. Also 38%, 3395, and 
25% of this group scored significantly below the 
two-way analysis means on Digit Span, Vocabu- 


lary, and Similarities sub-tests. | 

ү! very small percentage of the SR's scored 
above or below thetwo-way analysis means on the 
Information, Comprehension, and Block Design 


sub-tests. 
Summary 


raphic description of the dif- 


i 2 gives ag di 
пица the three reading disability 


ferences between 
groups. 

In summary, 
two groups are st 
tests. The Object 
example, on wa 
significantly above 
неее, 429% of the d 

e means. , 
скен nl the SR group who Scored below the 
two-way analysis means on the Arithmetic Frid 
Digit Symbol sub-tests was much higher than + 
percentage of the MR group. In addition, a small- 
er percentage of the SR's scored above the two- 
way analysis means on the Picture Completion 
and the Picture Arrangement sub-tests. A high- 
er percentage of the SR's scored below the two- 
way analysis means on the Vocabulary and Simi- 
larities sub-tests. Also while approximately the 
same percentage of individuals in the MP group 
scored significantly above and below the two-way 


then, thedifferences between the 
riking in regard to certain sub- 
t Assembly sub-test is one, for 
ch only 5% of the MR's scored 
the two-way analysis means; 
s scored significantly 
the percentage of in- 
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analysis means, most of the individuals in the SR 
group Scores did not deviate from the two-way an- 
alysis means. 

Thus, the characteristic pattern for the total 
reading disability group in general would be high 
Picture Completion and Picture Arrangement sub- 
test scaled scores and possibly high Block Design 
and Object Assembly sub-test scaledscores. Al- 
so low Digit Span, Arithmetic, and Coding sub- 
tests and possibly Vocabulary might be included. 

For the MR’s, High Picture Completion and 
Picture Arrangement sub-test scaled scores with 
possibly high or low Block Design in sub-test 
scaled scores would be expected along with low 
Coding, Arithmetic, and Digit Span sub-test 
scores. 

For the SR’s, high scaled scores would be ex- 
pected on the Picture Completion, Object Assem- 
bly, and Picture Arrangement sub-tests. Also 
low Arithmetic, Coding, and Digit Span sub-test 
scaled scores along with possibly low Vocabulary 
and Similarities sub -test scaled scores could be 
anticipated. 


Interpretation and Implications for 
Further Research 


Now that we have detected certain sub-test pat- 
terns that are characteristic for mild and severe 
reading disability cases, what we do not know is 
the significance of these patterns. What we need 
is further research to test what these sub-tests 
really means. Ifthe Picture Completiontest means 
that the individual is able to detect small differ- 
ences in picture forms and the Picture Arrange- 
ment test measures the ability to see pictures in 
sequence, the implications for the teaching de- 
vices and measurements now being used in the 
field of reading would have to be reconsidered. If 
the Coding sub-test measures the rate of new 
learning or the visual-motor ability of individuals, 
the implications of this test could be widely spread. 
However, before we can use these sub-tests in 
accurately appraising the intellectual functioning 
in regard to retardationin reading, we must know 
what these tests represent. It would also be val- 
uable to explore the validity of this two-way meth- 
od in the diagnosis of certain populations such as 
the mentally deficient and the emotionally dis- 
turbed. For example, since clinicians are now 
using parts of this analysis, it would be interest- 
ing to see the results of this method applied to dif- 
ferent types of cases which they diagnose. In this 
way new relationships might be established be- 
tween certain types of disorders and the scatter 
of the WISC sub-test scaled scores. 

The two-dimensional approach used in the anal- 
ysis of sub- test scatter in this paper appears to 
present a more precise and meaningful analysis 
of intellectual functioning than do uni-dimensional 
analyses of scatter in such studies as Atlus (1), 
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ortenier (3), and Wilke 
Gy since dt зване г pe: reference for judg- 
We the extent of deviation on sub-test scores, 
m ter confidence can be attributed to the nature 
ve pas ее of the sub-test pattern. 
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PRE-TEST AND RE-TEST SCORES IN 


RETENTION CALCULATION * 


ELLIS BEECHER LITTLE 
University of Illinois, Chicago Undergraduate Division 


EXAMINATION OF several studies in retention 
will reveal certain methodological procedures 
characteristic of the “с onventional" method for 
the calculation of percent retention of meaningful 
material. 

The calculation of percent retention is accom- 
plished in the *tconventional" methodby adminis- 
tering a pre-test to the students who are to take 
the course, in order to determine how much 
course information is known in advance of course 
presentation. The student then takes the course. 
At the end of the course afinal examination is ad- 
ministered, and in order to determine how much 
the student learned in thecourse, his pre-test 
score is subtracted from his final examination 
score. At some later Ште--5 ix m onths , one 
year, two years, five years--a re-test is given 
the student. The score on this re-test minus the 
original pre-test score equals а score represent- 
ing the amount of information retained of informa- 
tion learned in the course. The percent retention 
is then calculated by dividing the score for ma- 
terial retained of material learned inthe course 
by the score for material learned in the course. 

Research evidence indicates, howeve r, that 
forgetting is a function of activities prior to the 
learning, 25 well as activities subs equent о the 
learning. We may assume that this applies not 
only to learning in а course, but also to material 
of the course that was known before the course 
was taken. In other words, à Score on a course 
pre-test would be expected to change because of 
activities prior to, and subsequent to the n 
represented by such а score. The as к р ion 
may be made, therefore, that à seca s i к 5 
answered correctly on a pre-test wills see re 
(drop) for those same items on the post- est an 
on the later or delayed re-test. Thi s is mar- 
cepted truism concerning M aterial 55. іп 
course and should apply to material of the course 
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* This article is 
nois. The writer is grateful to Prof 
mittee, and to Professor J. Thomas 


writing the thesis. 


based on an Ed. D. thesis presente ) 
essor В. Will Burnett, advisor and chairman of his special com- 
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that was known or learned before the course was 
started. 

Research evidence indicates also thatunder 
certain conditions the passage of time results in 
an improvement, rather than a decrement, in 
performance. Although Ballard's study may be 
criticizedfor its inadequate control of practice 
and rehearsal, it does suggest that improvement 
may take place between course completion and 
administration of a later or delayed re-test. The 
assumption may be made, therefore, that between 
the time of post-test administration atthetime of 
course completion, and the administration of the 
later or delayed re-test, some learning will take 
place. We need not go into the problem of whe- 
ther the learning was delayed course learning, 
new learning entirely, or a combination of both. 

Applying the above research evidence to the 
calculation of percent retention wehave a pre- 
test score which is comprised of the items ans- 
wered correctly at the time of pre-test adminis- 
tration; a post-test score which is comprised of 
two scores: 1) a score representing what is re- 
tained of what was known before the course was 
taken, 2) a score representing what is known as 
a result of course learning; and a delayed re-test 
score which is made up ofthree scores: 1) а 
score representing what is retained of what was 
known before the course was taken, 2)a score 
representing what is retained of what was learned 
in the course, 3) a score representing what is 
learned after the course is completed. 


Three problems present themselves at this 
point: 1) Will the pre-test score remain constant 
over a period of time? 2) Is learning taking place 
between the time of course completion and the 
time of re-test administration? 3) Ifthe pre-test 
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score does not remain constant and if there is 
learning taking place between the time of course 
completion and re-test administration, will these 
changes significantly affect the calculation of per- 
cent retention of meaningful material? 


Hypotheses 


a. That an item count of the items answered 
correctly on the pre-test, when compared to a 
count of those same items on both the post-test 
and delayed re-test, will show a drop on both the 
post-test and delayed re-test from what it was on 
the pre-test. 

b. That an item count of items found to be 
correct on the delayed re-test when compared 
item for item with items found to be correcton 
the pre-test and post-test will tend to show that 
learning has taken place between the time of 
course completion and the administration of the 
delayed re-test. 

The above hypotheses were then used in an ex- 
perimental determination of per cent retention of 
meaningful material as calculated by the formula: 

1. Score for correct pre-test 
items still correct on re-test. 
Re-test score- 
2. Score for material learned 


since course completion. 
х 100 = percent retention 


Score for correct pre-test 
items still correct on the 
post-test. 

son was then made between the ex- 
perimental percent retention as obtained from the 
above formula, and the‘‘conv entional’’ percent 
retention as calculated by the ‘‘conventional”’ for- 


Post-test score - 1. 


A compari 


mula: 
Re-test score - Pre-test score Х 100 - Percent 
Post-test score - Pre-test score Retention 


Method and Procedure 


of college students, twenty-six in 
hirty-eight in the other, were 
tested by а machine-graded type examination for 
recognition of biology material learned before 
taking a general biology course (pre-test), for re- 
cognition of material learned during the time of 
the course (post-test), and for recognition of ma- 
terial retained of material learned during the time 
of the course (re-test). In an attempt to insure 
a normal population, the students’ sten scores on 
the Michigan Vocabulary test were used as a ba- 
sis for student selection. 

For purposes of this study, test items dealing 
with facts in peginning biology were selected from 
a final examination. This final exam ination was 
compiled by 2 jury of several members of the De- 
partment of Biological Science, Chicago Under- 
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TABLEI 


| AVERAGE DIFFERENCE BETWEEN SCORES FOR ITEMS ANSWERED 
| CORRECTLY ОМ THE PRE-TEST AND FOR THE SAME ITEMS ОМ 
| THE POST-TEST AND RE- TEST 


a 


Group Ave. Dif. Between T Ave. Dif. Between T 
Pre-test and Post-test Pre-test and Re-test 

A. 
| February -2.8 4.6 -4.34 4.5 
September -3.4 5.0 -4.47 5.1 

A 

з 
TABLE II 


SCORES FOR MATERIAL LEARNED SINCE COURSE COMPLETION 


о 


Group Ave. No. of Items Answered T 
Correctly on Re-test and not 
Answered on Pre or Post-test 


ч February 44.1 4.2 


.8 4.1 
September n 


pp 
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which gives a probability of 1 in 473,000 that the 
difference could occur by chance. This is signif- 
icant at a confidence level way beyondone percent 
For the September group, the significance ratio 
is 5.0 which gives a probability of 1 in 3, 490, 000 
that the difference could occur by chance. This is 
significant at a confidence level approaching abso- 
lute certainty. 

As is also shown in Table I, the average dif- 
ference between items correctly answered on the 
pre-test that were also answered correctly onthe 
re-test, are score drops of -4.34 and -4.47 items, 
The coefficients of correlation between the orig- 
inal pre-test scores and thenumber of those same 
items correct on the re-test forthe February and 
September groups are . 87 and .79 respectively. 
When these coefficients of correlation are used in 
calculating EM1-M2, the significance ratios are 
found to be 4.5 and 5.1 which give probabilities 
of 1 іп 294, 000 and 1 in 4, 000, 000 that the differ- 
ences could occur by chance. 

Hypothesis b) states that an itemcount of items 
found to be correct on the re-test examination 
when compared item for item with items found to 
be correct on the post-test, will tend to show that 
learning has taken place between thetest of 
course completion and administration of the re- 
test examination. 

As shown in Table П, the average differences 
between an item count of items found to be cor- 
rect on the re-test examination and items found 
to be correct on the post-test examination are 
44.1 items for the February group, and «2.8 i- 
tems for the September group. The coefficients 
of correlation between the scores making up these 
averages аге .85 and . 88 respectively. Using 
these coefficients of correlation to calculate EMI 
-М2, the significance ratios of 4.2 and 5.1 are 
obtained. These ratios give probabilities of 1 т 
75, 200, and 1 in 48, 300 that the differences could 
occur by chance. 

Since the foregoing tests for significance of 
differences have all been significant at the one 
percent level of confidence or beyond, we may as- 
sume that there are other than chance factors re- 
sponsible for the differencesin scores herein 
tested. We may, therefore, accept hypothesis 
b), and state that an item count of items found to 
be correct on the re-test examination, when com- 
pared item for item with items found to be cor- 
rect on the post-test, will show that learning has 
taken place between the time of course completion 
and the time of the administration of the re-test. 

As shown in Table III, when the mean percent 
retention is calculated using the corrected scores 
of both hypothesis a) and hypothesis b) and when 
this mean percent retention is compared to the 
mean percent retention as calculated using the 
scores as they would be used in the ‘‘convention- 
al'" method, it is found that the mean percent re- 
tention as calculated by the experimental method 


is less than the 
mean perce i al 
lated by the “conventional,” m a анчы 


y the exper imental method intr oduced 
in this . 
ћ Study is 74 5 percent ( conventional ) 
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TABLE III 


PERCENT RETENTION AS CALCULATED BY “CONVENTIONAL” AND 
EXPERIMENTAL METHODS, ALSO SHOWING MEAN DIFFERENCE 
BETWEEN METHODS AND SIGNIFICANCE RATIO FOR DIFFERENCES 


Group Mean Percent Retention by Mean Percent Retention by Mean Difference m 
**Conventional" Calculation Experimental Calculation 
Ум 
February 71. 02% 64. 44% -6. 58% ‚96 
September 74. 50% 70. 30% -4.20% . 62 
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increased, the percent retention of material re- 
tained of material learned in the course is in- 
creased. 

3. When the score for the amount of material 
retained of the material learned in the course is 
increased (as it is when mate rial learned since 
course completion is taken into consideration) the 
percent retention of material retained of material 
learned in the course is decreased. 

4. These combined differences, some of them 
occurring in opposite directions, balance each 
other out to some extent. The February group's 
experimental percent retention of materiallearn- 
ed in the course was -6. 58% less on the average 
than its ‘‘percent retention’’ as calculated by the 
* conventional" method. The September group’s 
experimental percent retention of material learn- 
ed in the course was -4.10% less on the average 
than its percent retention as с alculated bythe 
‘conventional’? method. It is interesting to note 
that the average percent rete ntion as calculated 
by the experimental method is less in each case 
for both the February and September groups. 

However, the calculation of the average per- 
cent retention by the experimental method intro- 
duced in this study proved not to be statistically 
significant from the average percent retention as 
calculated by the ‘<conventional’’ method. 


Summary 


The following two hypotheses were tested: 

a. 1) That an item count of the items answer- 
ed correctly on the pre-test when co m pared toa 
count of those same items on the post-test will 
show a drop from what it was on the pre-test. 

b. That an item count of items found to be 
correct on the delayed re-test when compared i- 
tem for item with items found to be correct on the 
pre-test and post-test will tend to show that 
learning has taken place betweenthetime of 
course completion and administration of the de- 
layed re-test. 

Analysis of the results yields 
conclusions: 

1. The average score 
correctly on the pre-test 
count of the same items on 
a drop. 

2. The average sco 
correctly on the pre-test w 
count on the same items on 


a drop. 
3. Both score differences in 1) and 2) proved 


to be statistically significant. 

4. The score for the item s found to be cor- 
rect on the re-test, that were not found to be cor- 
rect on the post-test or pre- test, indicated that 
learning had taken place since course completion. 

5. The differences between these scores 


oved to be significant. 
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PERSONALITY PATTERNS OF 
PROSPECTIVE TEACHERS 


ROBERT F. PECK 
University of Texas 


THE PERSONALITIES of teachers have long 
been known to influence the effectiveness of their 
teaching (3, 5, 10, 12, 14). There have been at 
least two knotty problems, however, in establish- 
ing the exact nature of the complex relationships 
between personality and teaching effecti venes s. 
First, there have not been very effec tive mea- 
sures for those aspects of personality which are 
especially pertinent to teaching per formance. 
Many early studies relied on existing ““регвопа!- 
Ну” questionnaires of a self-report kind. These 
were seldom designed to measure characteristics 
central to the teaching process; ог, ifthey pur- 
ported to be, they were prey to the reluctance of 
most respondents to appraise themselves frankly 
and accurately (2, 4). The other problem ] of 
course, is the great difficulty in obtaining crite- 
rion measures of personality which are them- 
selves valid and meaningful (11). 

The present paper reports an exploratory study 
aimed at improving the definition of teaching-rel- 
evant personality characteristics, as these char- 
acteristics appear and are measurable in projec- 
tive data. The findings may suggest new mea- 
f these personality character istics, in 
e form. The findings from this 
tive teachers also suggest some 
features about the kinds of 
are today preparing to teach. If 
erifies these data, a much in- 
d personal couns eling pro- 
dicated as anecessary part of 
ion of atleast half of our 


sures О 
more quantitativ 
study of prospec 
rather disquieting 
young people who 
later investigation v 
creased guidance апі 
gram would seem їп 
the professional preparat 


future teachers. M" 
The present report can only be taken provision- 


inline with Barr's observation that 

pon Red cdm but trouble ahead in ап тезеагсћ 
(or) it wouldn't be research” (4), despite an extra 
year of work following the study reported here, it 
proved impossible to both locate in teac hing and 
have assessed (by supervisors) enough graduates 
from this sample of 69 college students to provide 
om on-the-job performance. 


a criterion derived fr 
There was validity evidence from comparable 


* Footnotes will be found at the end of the article. 


personality studies by the writer, as well as par- 
allel data on the subjectsin the form of self-ap- 
praisal instruments for the measurement of per- 
sonal adjustment and maturity. 


Procedure 


А sentence completion instrument designed for 
use with college students, (Peck Sentence Com- 
pletion, Form 2-B) was administered to a random 
sample of 69 junior and senior women majoring 
in elementary education at the University of Tex- 
as or at a state teachers college. Ateam of three 
--Kathleen Keen?, Aubrey Roden, andthe writer 
--jointly analyzed the protocols and rated the 
subjects on a nine-point scale of general ‘‘Teach- 
ing Potential. ’’ 

Since the personality analysis was done incon- 
ference style, to maximize accuracy and penetra- 
tion, the appropriate measure of reliability was a 
re-rating of the 69 cases, some months later. At 
that time, rate-rerate reliability was found to be 
. 88. 

The Teaching Potential rating required simul- 
taneous weighing of twofactors: the subject’s a- 
bility to perceive, organize and communicate in- 
formation in an objective, orderly manner (‘‘aca- 
demic’’ teaching ability), and her probable influ- 
ence for good or ill on the mental health of her 
pupils. After all cases had been finally re-rated, 
the research team examined the subjects who were 
grouped at each scale point and constructed а 
qualitative description of salient personality char- 
acteristics of each group on the scale. 

The scores on the Teaching Potential scale 
were then correlated with scores on four other 
personality measures which had been administer- 
ed at the same time as the sentence completion. 
These included the Lefkowitz Rigidity Scale, the 
Worchel Self-Activity Inventory, the McCandless 
Anxiety Scale, and a Mental Health Q-Sort devel- 
oped by the writer with the aid of McGuire and 
others. 
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Results and Discussion 


The correlations of the Teaching Potentialrat- 
ing with the other instruments are as follows: 
Rigidity Scale, -.42 (significant at .011evel); SAI 
total score (the weighted number of problems 
checked as self-descriptive) -.20; SAI Self-ideal 
discrepancy score, -.33 (significantat .01 level); 
McCandless Anxiety Scale, .05; Mental Heal th 
Q-Sort, *'maturity" score, .28 (significant at 
. 05 level). 

Self-descriptive measures such as these have 
uncertain validity themselves. Moreover, these 
are not all designed in such a way that one would 
reasonably expect a simple, linear relationship 
with such an overall rating as the Teaching Poten- 
tial score. However, there is a Significant de- 
gree of agreement with all but the McCandless 
instrument, in the expected direction. The Т-Р 
ratings correlate negatively with self-as cribed 
rigidity and with discrepancy between perceived 
self and ideal (desired) self; The T-P ratings 
correlate positively with the ‘‘maturity’’ score on 
the Q-Sort. Thus, so far as this evidence goes, 

it suggests that the Teaching Potential ratings 
tended to be valid. Perhaps this is about as much 
correspondence as one could expect when compar- 
ing judges' appraisals with Self-appraisals in this 
area that is so loaded with the Social desirability 
effect. 

Ideally, depth appraisals b 
judges, using other kinds of 
desirable criterion for testing the validity of the 
personality descriptions. Failing this--primarily 
for reasons of research economics in the present 
instance--a next-best measure is to establish the 
credibility, or validity, of the judges (not just of 
the type of data used). Evidence from some anal- 
ogous studies shows validity co efficients of this 
kind, of .65 to .83 (7, 8, 9), 

The subjects grouped together at each of the 
nine points on the scale (**one" was the lowest 
score) were analyzed to determine what сћагас- 
teristics typified that group and differentiated it 
from the groups above and below it. 

Scale Point One (Four subjects rated here). 
Two sub-types appear here: (a) A pattern of se- 
vere personality disorganization, expressed in a- 
cutely conflicting attitudes, very unstable emo- 
tionality and mental confusion.This disorganization 
is so manifest and strong that it appears likely to 
be very actively upsetting and confusing to pupils 
if these girls were to teach. The extreme exam- 
В is a girl who seems unmistakably to be a full- 
end though very quiet, schizophrenic who se 

sychotic confusion apparently had not been evi- 
rod pecu ad enough to call official atten- 
я ition. 
tion То nor extreme hostility, openly and 

(b) ~ (е actedouton frequent occasions. Рег- 

eco flavor of this may be conveyed by quoting 


yother trained 
data, would be the 
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the all too typical response of a young pei ri 
woman who wrote ‘‘Most people don't know that 
Own a brat." Апа {һїз was not the strongest of 
her numerous expressions of bitterness and vp 
tility. In all cases in this pattern, as might HS 
inferred from the lack of self-control, both wee 
affect-states and the ego-functions of these ow 
were markedly childlike and unorganized. be 
were rated very low because it appeared “пот 
certain that they would actively hurt, an EP a 
and deeply upset pupils in a way destructive а 
of mental health and of efficient learning of SC 
subjects. ; 

Scale Point Two (Eight subjects rated €— 
These girls show some active mental саш. the 
but they manage to ‘‘make sense’’ most у hos- 
time. They also reveal intense feelings r jt and 
tility; but unlike the “Ones, ” they contro be 
do not act it out except for s poradic aar m great 
bursts when immediate stresses become 
for their repressive and Suppressive pos 
restraints. They are, nonetheless, Ж 
frankly unhappy in a deep, al] -регуа chielly 
They are rated higher than the ‘Ones “4 an ac- 
because they appear less likely to ase" influence 
tively destructive or severely confusing! 


npre- 

оп Pupils. They would still pe somewhat or own 

dictable, upsetting, and apt to spread t leasant 
Strong unhappiness to а degree that is шар 

even if it is not acutely disruptive 

k re). 

Scale Point Three(Twelve subjects rates апей 

The girls in this group are actively unsa Ones 

ly unhappy, as are пе They 

ssly discontented. als in 


What makes them passable performers, it seem?» 
is their passi i 

ingness to accede 
rective system (such as a ir par- 

school, or thei 
ents) may make of them. They would “walk 
find of teacher, it seems likely, к 
it, but oe personal meaning ог en joy ment "a 
» but als i : in 

influence, . exerting any actively upsetti 


» it seems, who could be hired 
any school, without anyone 

eyebrow. Thereis nothin g‘ bises 

; Man active 5 Я г hand, 

they would Seer lika ense. Onthe othe 

thei 


done if not firmly and steadily led. 
Scale Point Four (Fourteen s ub jects rated 
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herc). These girls, too, show a restless dissat- 
isfaction with their lives, and an unfocused but 
strong longing for more ‘‘point’’ to life. Their 
dominant mood-tone is one of moderate unhappi- 
ness or discontent, but it is much more attenuat- 
ed than is true of the lower groups. In addition, 
these girls show an active conscientiousness. 
They are not very well organized in the way they 
think and act, but given some helpful guidelines 
to follow, they go at tasks witha measured degree 
of active interest and purposefulness. 

Jt may be that, unlike any of the preceding 
groups, these girls could rather quickly and read- 
ily be trained to be effective teachers and pur- 
poseful, reasonably well organized people in gen- 
eral, if they are given active, interested, per- 
sonal, rather intensive on-the-job leadership and 
training for some two or three years. Unl ike 
the lower groups, they have some degree of posi- 
tive interest in life, already. It is quite vague, 
unharnessed and unpracticed; it is also oversha- 
dowed by somewhat more pervasive negative feel- 
ings about life and self; but it is there as a pres- 
ent motivation which could be brought out and 
developed. | 

It seems clear, however, that it would require 
personally interested, individualized leadership 
to bring out this potentiality. No formal system 
of training or ‘‘leadership’’, however well organ- 
ized in theory, would “геасһ” these girls, if it 
lacks the personal element of a 1 eader or guide 
who feels a genuine, human interest in each girl 
as an individual. This is not intended as a Peale- 
ish homily, on rosy ‘‘general principles. ’’ Rather 
it stems from the specific lacks and needs these 
particular girls appear todemo ns trate. Their 
lack is not a lack of formal training: the y have 
already had sixteen years of schooling, including 
teacher training. Their need, and their lack, ар- 
go much further back into their family 
years, to be much more intensely per sonal, and 
to concern profound emotional needs more than a 
need for conscious intellectual training i 

So far, all the intellectual training bei rm 
received has not “Чакеп” very deeply or usefully, 
not because of deficient intelligence, but apparent 
ly because of their continuing SS an wi 
vaguely perceived but жалы Ennius eh poen 

-security. It mig 3 
ета” TOF them would have to be patie иу 
understanding, too, because most of ге ee 5 
would humanly resent and defen sively resis ki 
* critical" pointing out of their very real person 
problems. Finally, it mightbe that effective gui- 
dance could rather economically mobilize and put 
to work all the intellectual training which they 
have gathered and which at present must be lying 
latent in their minds, unorganized and largely un- 
-— Point Five (Eight subjects rated here). 
These girls might be summed up as quiet, re- 


pear to 


sponsible, efficient conformers. Theyshow very 
little active, personal initiative but once they are 
given a role to fulfill, they perform in a sensible, 
orderly way. They show no particularly active 
enthusiasm for life or for teaching, but neither 
do they experience much unhappiness or marked 
dissatisfaction. They appear to be quite stably 
what they are: not at all inspired or inspiring, but 
quietly competent. If they would not arouse 
strong learning motivation in pupils by their own 
interested example, they would nonetheless carry 
out their assigned teaching duties in a calm, rel- 
atively cool, impersonal way. They do not dem- 
onstrate any active, special, personal interest in 
teaching, whether as an avenue for self-realiza- 
tion, as a way of establishing gratifying human 
relationships with children, or in any other way. 
Itis a job; if they take it, they will do it as pre- 
Scribed; and that seems to be that. 

Scale Point Six (Four subjects rated here). As 
one moves up the scale, this is the first group 
which shows a degree of active, independent pur- 
posefulness. These girls arealsothe first group 
to show a predominantly pleasant, good-natured 
reaction to life. They have some personal goals 
which they can actively pursue when circumstan- 
ces actively permit and encourage it. They are 
not especially well organized nor extremely pur- 
poseful in the way they act. Much of the time, 
they cheerfully go along with the social and pro- 
fessional currents around them, in a spontaneous 
but rather unthinking way. They can muster some 
personal initiative, however, if there is some- 
thing they want very much andnoone else is pro- 
viding it for them. In their own way, they appear 
to have a relatively stable, reasonably satisfied 
way of fitting in withlife as they know it. They 
are not apt to exert much sustained effort to un- 
derstand a particular child (or adult) in order to 
meet that other person's special need. But their 
customary good nature has a pleasant effect on 
others' feelings in a general way. Furthermore, 
these girls carry out their duties, once assigned. 
with some degree of active thought as to the pur- 
pose of what they are doing; or atleast about how 
well it is or isn’t working. They do not proceed 
in a purely mechanical or ritualizedmanner. 
They are neither much interested, at base, inbe- 
ing expert intellectualizers, nor prone to exercise 
much imagination about new or better ways to 
teach some topic. Nevertheless, toa mild degree 
they probably would ''adapt the subject matter to 
the child," largely because they are most com- 
fortable when everyone around them is comfort- 
able--and a school pupil is apt to be most *'com- 
fortable’ when what he has to do makes sense to 
him. 

Scale Point Seven (Five subjects rated here). 
This group presents the first instance (ascending 
the scale) of a reasonably well-defined, firm ego 
Structure. These girls show a distinctive, if in 


172 JOURNAL OF EXPERIMENTAL EDUCATION 


ill-emerging, individuality. They 
ее а inlife which they 
look toward with personal interest. Their gen- 
eral feeling about their past is notone of unalloy- 
; some parts were and are pain- 
ed pleasaniness; UPS of giving into that, they 
Wd. Moeren = to find positive rewards in 
are actively striving 10 1th а find- 
the present and future; and they feel they zm 4 
ing and will find them. They are somewhat res д 
less, experience some marked НЕ ап 
inner conflicts about what they “really want to 
ре, and дао”; but on the whole they аге actively in 
the process of becoming masters of their feelings, 
their actions and their ownlives, rather than be- 
ing the passive pawns of circumstances and exter- 
nal pressures. 

They are not quite as stable, well - organized 
and vigorously purposeful, especially in the direc- 
tion of a teaching career, as the Eights and Nines, 
though notable individual differences exist. Two 
girls are powerfully motivated toward social mo- 
bility, and well equipped to achieve it, it appears. 
One of them is distinctly not going to teach, or 
not more than a year or two, it seems ce rtain. 
She will probably either marrya rising young 
man or find an individually expressive career in 
journalism or an allied field. The other **mobile^ 
girl may become a careerteacher, if children of 
her own do not intervene; but here her al most 
too-powerful manipulative drive appears [0 some- 
what reduce the healthiness of her impact on pu- 
pils from an otherwise excellent level of effec- 
tiveness. 

One of the other girls in the group 


is frankly 
far more interested in marriage and a family of 
her own than in а teaching career. If She did 


teach, she would be a lively, Stimulating person, 
but off-hand enough in her attitude to reduce her 
effectiveness from top level. The other two girls 
are more shy, more interested in teaching, 
though also more unsure of themselves and Some- 
what hesitant to take firm stands. Underne ath, 
though, they have agrowing firmness which could 
well surprise people who **know them ул 
think they do. These girls are extremely Sincere, 
as indeed are all the girls at thislevel and higher, 

Thus, for somewhat varied reasons, the girls 
in this group show good capacities and POSitive 
attitudes toward life. Some are here, rather 
than higher, because of a pronounced lack of in- 
terest in teaching as an occupation; some ‚ be- 
cause of moderate personal problems which keep 
them, as yet, from full, unhampered application 
of their basically solid, constructive aptitud ев 
and attitudes. | 

Scale Point Eight (Nine subjects rated here), 

se girls are, to a woman, extremely зепз_ 
ide, well organized and clear-sightedly purpose- 
ful. By contrast with most members of the pre. 
ceding groups, they are all ar rac terized by а 
high level of available and applied energy, They 


ell? or 


go at life with considerable zest,if not with un- 
mixed pleasure, then with firm determination to 
make the best of it. They are thoroughly realis- 
tic. They also find life much more satisfying 
than not. They have firm self-confidence, on the 
Whole, and take responsibility for the way their 
lives work out. It things go wrong, they may dis- 
like some other person who may have been partly 
responsible; but instead of moping or feeling pro- 
longed resentment about it, they figure out ways 
to create new satisfactions for themselves. 

These subjects were rated below the Nines, 
partly for varied, individual reason S, partly on 
general grounds of not quite as high a degree of 
creative, applied intelligence, not quite as com- 
plete and mature autonomy, and/or not quite as 
Strong and specific a dedication to teaching as à 
major personal interest. Apartfrom these dif- 
ferences of degree, there are no marked differ- 
ences between the Eights and Nines. 

Scale Point Nine (Five subjects rated here). 
These women (whatever their age, psychological- 
ly they appear too mature to be termed ‘‘girls’’) 
possess outstanding degrees of several charac- 
teristics, all bound together into a unified pattern. 
While thoroughly human, in that they know what it 


is to experience conflict, disappointment and frus- 
tration, they are both sol 
lives and ver 


ing themselves to 
Satisfying pursuit. 
ferences in person 
share seems to be 


А › 3 neurotically over- mined 
drive); a very зе y over-deter 


other people. Quite 
another these women 
о treat others in a de- 
just аз they make constructive Way. Moreover, 


и Rather, their 
The result is ' it might be said, work to- 


about other peopl that they can care deeply 
Sponsibilities ы other: іп One case, about her re- 
same time ег People, at least. ang at the 


3 they c v rm. 
judgment, У Can maintain Objective, accurate 


Gm 


ін 
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Finally, these women were rated highest on 
teaching potentiality for the rather self-evident 
reason that, in one way or another, they actively 
choose teaching as a personally sought career. 
This, added to their aptitudes, maturity and pur- 
poseful vigor, seems reason to expect them to per- 
form extremely well, both as academic instruc- 
tors and as influential examples of thorough ma- 
turity and emotional health. 


Implications of the Teaching Potential Distribution 


Without further validation, the distribution of 
ratings assigned to the 69 subjects cannot be un- 
critically accepted as a statement of fact. Still, 
if the ratings even roughly approximate the true 
picture, there would be a number of practical im- 
plications of considerable importance. The over- 
all distribution is as follows; and it might be not- 
ed that these subjects p r esumably represent the 
“cream of the crop" of the nation's youth, both 
intellectually and in social acceptability. 

Scale Point: 12 3 4567 8 9 
No. of Cases: 4 8 12 14 8 4 5 9 5 | 
This is skewed toward the high end. The distri- 
bution is distinctly a bi-modal one, however; and 
if the psychological meaning of the scale points is 
considered, the appropriate break-point in terms 
of desirable personal qualities for teaching might 
be drawn between points 5 and 6. In that case, it 
appears that only one-third of the total sample 
show the traits one would like tohave in all teach- 
ers. Two-thirds range from aquietly uninspired, 
somewhat rigidly conformist p attern (Р oint 5) 
through a large group of aimlessly discontented 
girls (4 and 3), down to a group of acutely unhap- 
ру, confused, actively upsetting girls who look 
quite undesirable as teachers of children(2 and 1). 

Even using à conservative criterion which calls 
only groups 1-4 ‘‘below average, 380f the 69 
subjects show characteristics which are scarcely 
desirable in a teacher. They are: discontentedly 
unhappy, in general, increasing to bitter hostility 
at the lowest levels; lacking meaningful Бике 
goals and lacking effective skill at mx an 
pursuing such goals; restless, aimless "€ ы. 
ganized in their thinking, ranging паре о ex 
treme confusion at the lowest level; ап 4 еу Lo 
mistrustfully lacking in any hoe ed труе 
ness toward other people а great deal ce e time, 
ranging down to open, destructive hostility. 


The 12 girls at levels one and two Ба 
should not enter teaching. They are too contuse 
turb children and 


ostile to do other than distt 
д. interfere with their learning: Pen 
jects could appropriately be termed s eve ely 
neurotic; and they include one who shows үтү 
sign of being frankly psychotic. In asense, t Eod 
irls should not present an insuperable practic 
Problem. Barring intensive psychotherapy, they 


should be excluded from teaching. This is ап 


**administrator's'' point of view, of course. 

In actuality, it seems a major indictment of 
the depersonalized ignorance about individuals in 
colleges of education that girls like these should 
have been permitted, even encouraged, to go 
through the entire program of teacher prepara- 
tion. Even a crude screening on grounds of per- 
sonal attitudes and adjustment could identify most 
of these girls beforethey ever entered ateacher- 
training program. Thereafter, if either the need 
for teachers or a desire to help these girls indi- 
cated, some measure of adjustment guidance 
could conceivably be provided. Without it, they 
remain extremely disturbed in their personal 
lives and almost certainly unfit to teach. In this 
sample, they constitute a disquieting 1775; and 
they are even more likely to go into teaching and 
stay in it than are the girls at the highest three 
levels on the scale. The ''high" girls have very 
attractive qualities, are interested in marriage, 
and many seem likely to marry out of teaching 
permanently. These “10ч” girls, on the other 
hand, are scarcely attractive prospects for mar- 
riage in their personalities, even though they too 
would like to marry. It appears not unlikely that 
many of them will take the opportunity to make a 
lifetime career of teaching. То be blunt about it, 
they can probably get teaching jobs when no one 
else or no other kind of organization would take 
them, or retain them long. 

In many ways, though, the most challenging 
problem is presented by the 26 girls at levels 3 
and 4 on the T-P scale. They constitute over 
one-third of the combined sample. Asthe des- 
criptions indicate, they are not completely lack- 
ing in potential ability to teach adequately, but 
they are far from what any school administrator 
would knowingly pick for his teaching staff, if he 
had any free choice. Yet these girls appear sig- 
nificantly unlike the ones at the lower levels. 
They are aware, however vaguely and unhappily, 
that their lives lack meaning and purpose. They 
would like to change this, if they only knew how. 
That they do not know how seems to reflect а 
learning deficiency rather than a neurotic over- 
learning of irrational reactions. They resemble 
children who have been taught, life-long, to do 
nothing ‘‘until Momma ог Papa tells you,” by 
parents who are too preoccupied or too blindly im- 
itative of ritualized conventions to do much posi- 
tive ‘‘telling.’’ In this respect, these girls re- 
semble even those at level Five, to some degree. 
Their problem seems less one of distorted learn- 
ing (neurotic or psychotic) than of an absence of 
learning. In particular, they lack the skills to 
conceive and initiate important, rewarding acti- 
vities, and they also lack a confident sense that 
it would be right and proper to initiate such au- 
tonomous seeking for meaning and satisfaction in 
life. 

The most apt phrase for these girls' problem 
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may be ‘‘psychological emptiness.” This phrase, 
atleast, seems to convey the difference between 
the conflicted, neurotic states exemplified by the 
subjects on levels One and Two, and the relative- 
ly unconflicted but aimless, childishly ‘‘helpless”’ 
state which these girls at the next higher levels 
are experiencing. In many ways, this state re- 
sembles what David Riesman has described in 
The Lonely Crowd--especially his **Outer-direct- 
ed” type of personality. 

These girls, too, are most likely to fall back 
on a teaching career for want of any personally 
defined goals which have an active appeal. For 
most of them, teaching presents the only area of 
“‘guaranteed’’ security and orderly purpose which 
they have found or can conceive of finding. They 
are not lacking in intelligence: at least they have 
almost completed college. И, moreove r, they 
are among those most likely to Seek, get and keep 
teaching jobs, it would seem highly desirable to 
give them much effective personal guidance dur- 
ing their college years, and effective on-the- job 
guidance. At present, it is an unwelcome but re- 
cognized fact that neither adequate college guid- 
ance nor attentive, individualized in-service guid- 
ance is being provided for peoplelike this, ex- 
cept in extremely rare instances. 

The very fact that so many ‘‘wish y-washy," 
socially and intellectually inept students could get 
this far in professional training seems uncom- 
fortably clear evidence that there is a profound 
lack of knowledge about individual Students on the 
part of their professional mentors, the faculties 
of their colleges. For if these girls were recog- 
nized for what they are, andstill nothing was done, 
it would not speak very well for the professional 
integrity or the standards of their educ ational 
mentors. 

Perhaps, though, this is a most unfair inter- 
pretation. With the seriously lowlevel of budget - 
ary support for these colleges of education, the 
undergraduate student-teacher ratio is knownto 
be far too high to permit any but an almost overly 
zealous professor to get to know his or her stu- 
dents at all well, as individual people. Further- 
more, the extremely scanty funds and Staff avail- 
able for guidance make intensive guidance almost 
impossible, in all but a very few cases. Indeed, 
in the words of one university administrator, over 
90% of what little guidance is available is spent on 
students who have passed the point of по г eturn 
through academic failure. In brief, a practical 
person might conclude that teaching positions will 
inevitably continue to be manned by aim] ess, o- 
ver-dependent, intellectually inept, discontented- 
ly unhappy women in one-third to one-half of all 
instances. In that case, perhaps we should stop 
preaching empty platitudes about good teaching,” 
Indeed, we might well save much time now large- 
ly wasted on such E o illusion that we 
are ‘‘training their minos. hese girls are 


any evidence, we aren't even “reaching” them in 
any personally meaningful way. 

Yet such a pessimistic resignation is not only 
repugnant; it is actually contradicted by ce rtain 
evidence in the presentdata. For just these girls, 
in particular, school seems to have been the one 
area of life where they have predictably found 
some measure of meaningful order, kindly, en- 
couraging treatment by some teachers, anda 
modicum of self-respect through the learning of 
Some purposeful skills. Clearly, this has not 
been enough to compensate for earlier, family- 
based lacks, nor to bring them farther along than 
they now stand in their personal maturation; but 
just as clearly, it suggeststhat schools and col- 
leges have an already-established foothold with 
these girls. Whatever extra effort could possib- 
ly be invested, perhaps in the general kind of 
guidance suggested for the Scale Point Four sub- 
jects above, such effort appears to have a good 
chance of paying off in the form of better organ- 
ized, more enthused, interested teachers (13). 

Needless to Say, the one-third of the sample 
at levels Six through Nine require little morethan 
active encouragement to be their healthy, good- 
natured, intelligently purposefulselves. Conven- 
tional professional training seems well suited for 
the preparation of Suchteachers-to-be. As far 
as concerns future research, and educational pol- 
ісу, people like these might well serve asthe 
models for criterion-development in the defining 
of ‘effective teaching. ” Certainly, they repre- 
sent many diverse patterns of interest and behav- 
IOr-Style. There is no one pattern of “the good 
teacher," here 
few are firmly im 
going, some аге 
major emphasis 


па: sion 
of the other. ) hese goals to the exclusi 


Е reasons of persona] difference, dif- 
rognoses were m pe 
concerni erii e d de 


Р girl seemed likely to function 
With peak effective А warm but shy, slight- 
Seen as a highly effec- 
To put the same girl 10 


Junior high schools might be tanta- 
mount to «+ rOwWin| 5 
Е her to the . 7? Соп- 
versely, a hyper-ener Qo 


jl 
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This kind of attempt to match the particular 
person with a particular job is becoming a rather 
accepted procedure in industry. It is only its ap- 
plication to teacher-training and placement which 
is relatively new and untried. 


Summary and Prospect 


Personality analyses were made of 69 under- 


graduate women majoring in elementary education. 


The available validity evidence moderately tended 
to confirm an overall rating on **teaching poten- 
tial, ’’ based on personality analyses from sen- 
tence completion data. Salient characteristics of 
the subjects at each level onthe T-P scale were 
described, and implications for teacher education 
were discussed. 

If these personality с haracteristics can be 
measured by additional methods, while converting 
the qualitative analysis of the projective data into 
quantitative measures, ameans might be develop- 
ed for predicting teacher effect iveness with in- 
creased accuracy. Such an undertaking is planned 
as part of the new five-year research program of 
the Mental Health Demonstration C en ter atthe 
University of Texas, supported by a grant from 
The National Institute of Mental Health. Valida- 
tion is planned against both expert personality ap- 
praisal from independent data and observational 
data on teaching performance in the years after 


college. 
FOOTNOTES 
1. This research was part of aprogram support- 


ed by funds from the Hogg Foundation of Men- 


tal Health. | 
2. Now at the Menninger Foundation, Topeka, 


Kansas. | | 
Now at the University of California, Berkeley, 


California. 
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FACTOR ANALYSES OF THREE TESTS 


OF CRITICAL THINKING * 


VELMA I. RUST 
University of Illinois 


FOR SEVERAL decades measurement of crit- 
ical thinking skills and abilities has presented a 
major difficulty because educators have not agreed 
on the kind of measurement which should be used. 
There has even been a lack of agreement regard- 
ing a definition for critical thinking. The problem 
of measurement is the focus of this study. In a 
search for common elements in the operational 
definitions of critical thinking used by diffe rent 
researchers, three tests of critical thinking were 
analyzed. 

This research arose from the find ings of the 
Illinois Curriculum Program Committee relative 
to its Critical Thinking Project (9). When the 
Project Committee and the cooperating teachers 
wanted to evaluate their attempt to teach the prin- 
ciples of critical thinking, the following three tests 
were selected for the purpose: the Watson-Glaser 
Critical Thinking Appraisal, Form Bm; A Testof 
Critical Thinking, Form G, prepared by the A- 
merican Council on Education; and A Test on 
Principles of Critical Thinking, Form Fl. 5, pre- 
pared by the Project staff (hereafter called the 
Watson-Glaser, ACE, and Principles tests re- 

ively). 
ы ПЕ -— were obtained between 
total scores on any two of these tests. These low 
intercorrelations led to theinference that there 
is little relationship between the knowledge of pri 
principles of critical thing and Ше AES о 

inciples. е ~ | 

а felt the need for more inform аас d 
regarding the internal structure of the three crit- 
ical thinking tests. | 

Тће о т ана of factor analysis У дады 2r 
the purpose of determining whether the Eie 5 д 
tually do measure what they are supposed to un 
sure according to the a priori reasoning d 
test makers. The research hypothesis tested was 


и 
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that factor analyses of these three tests of criti- 
cal thinking will yield some common factors a- 
mong the items in these three tests. 


Objectives 


Specifically, the objectives of the study were 
threefold. The first of these was to study each 
test individually by factor analysisin order to 
check the a priori reasoning of the makers of the 
test regarding appropriate grouping of items, It 
was thought that such studies would give more in- 
sight into the internal structure of thetests them- 
selves. It was also hoped they would yield some 
clues regarding the correctness of the judgm ent 
of the Illinois Critical Thinking Project Commit- 
tee that several items have no place in tests of 
critical thinking and might well be deleted. 

A second objective was to plan a factor analy- 
515 of a composite test made up of selected items 
from all three tests for the purpose of ascertain- 
ing whether or not the three tests measure the 
same skills and abilities. Moreover, it was rea- 
soned that with the information gathered from the 
four factor analyses, viz., the Watson- Glaser 
Critical Thinking Appraisal, the ACE Test of 
Critical Thinking, the Principles of Critical 
Thinking test, and a composite test, it should be 
possible either to improve the Test on Principles 
prepared by the Project Committee or to enable 
a new test to be developed. 

The improvement of the Principles test became 
the third and most important objective. In other 
words, an effort was made to determine whether 
or not the Principles test actually tested what it 
was supposed to test according to its makers. 


Procedure 
From the group of about three thousand stu- 


ary of a major piece of research completed in partial fulfillment of the require- 
f Doctor of Philosophy in Education in the Graduate College of the University 
ththe preparation of the dissertation, the author is deeply indebted to 
esis committee, namely, Dr. Kenneth B. Henderson, Chairman; Dr. R. Stew- 
Burkholder, Dr. Franz E. Hohn, Dr. PhilipJ. Runkel, and Dr. Henry Е. Kaiser. 
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dents involved in the original Critical Thinking 
Project, 949 students were selected, namely, 
those who took the Watson-Glaser, the ACE, and 
the Principles tests. Theanswer sheets for these 
students for all three tests were carefully scru- 
tinized. If any item on any test was omitted by a 
Student, that student's scores were discarded. In 
this way the number of subjects was reduced to 
987. A side investigation later completed showed 
that this sampling technique had not created bias 
with respect to intelligence test scores or to 
scores on the achievement tests administered by 
the Project staff. 

Before carrying out the factor analysis, each 
test and its manual were perused carefully for the 
purpose of discovering what the test makers had 
in mind when they prepared their test, that is, 
what they believed critical thinking involved and 
what aspects of it they hoped to test. Inter-item 
correlation matrices were then obtained Separate- 
ly for the three tests. Phicoefficients were used 
since the data were dichotomous. 

The centroid method of factoring was employ- 
ed. Since the purpose of a factor analysis here 
was to analyze the common factors that might ex- 
plain the intercorrelations, comm unalities, in- 
Stead of unity, should have been written in the di- 
agonals. However, at the risk of increasing the 
rank of the correlation matrix and of forcing the 
unique variance into the common factor matrix, 
it was decided to use unity inthe diagonal cells of 
all matrices. This decision was justifiedon the fol- 
lowing grounds: (a) Because of the large size of 
the correlation matrices, the factorial results 
would not be seriously affected by coarse initial 
estimates for the diagonal cells; (b) To use any 
known formula to compute better estimates would 
have multiplied the required computer time by at 
least six or seven times, and any slight increase 
in accuracy gained at this stage did not Seem to 
warrant such expenditure of time. 

The factor analysis procedure yielded only one 
weak general factor for each of the three tests. 
ТЕ was, moreover, practically impossible to es- 
timate how many factors should be sought. The 
gradations in the amount of variance accounted 
for were so slight that one could have gone on 

ing indefinitely. 
mro point it was decided nothing could be 
gained by attempting to rotate to oblique Simple 
structure, or by factor analysis of a composite 
test. It was believed that since no strong com- 

n factors within each of the tests separatel y 
is discovered, and since correlations between 
о f the three tests were low, there was 
any E кыйнай that there would be found any 
uthe u не" rs common to all three tests.Instead, 
gtrong 56 t additional clues regarding 
a final attempt to ge 

: al structure of the tests was made by 
the intern he oscilloscope of the Illiac plots of 

throwing on the the first eight centroid factors 
pairs of factors for 


and photographing these. Since the results were 
not encouraging, no further use was made of the 
computer or the factor analysis procedure. 


Findings 


Table I shows what the makers of the three 
critical thinking tests were hoping to test. It will 
be noted that, to some extent, the different tests 
emphasize different aspects of critical thinking. 

Compilations of frequencies of correct respon- 
Ses showed that the Watson-Glaser and ACE tests 
were easy for the group of students concerned. 
Mean item difficulties for the tests were: Watson 
-Glaser, 0.66; ACE, 0.67; and Principles, 0.51. 
On the whole, inter-item phi correlation coeffi- 
cients were low. The higher correlations tended 
to cluster along the diagonal, thus lending support 
to the a priori reasoning of the test makers re- 
garding grouping of items. The size of phi corre- 
lation coefficients between pairs of items of the 
Watson-Glaser test ranged from approximate ly 
-0. 325 to approximately +0.675. There were on- 
ly six cases of a phi coefficient higher than +0.375, 
and the highest correlation Coefficient, which was 
+0. 626, was between items 38 and 39 which the 
test makers grouped under the subtest labeled 
“Deduction. '' In the case of the ACE test, phi 
coefficients ranged from approximately -0.125 to 
approximately +0.725, and for the Principles test 
from approximately -0.175 to approximately 
+0. 375. 

Loadings of items on the first centroid factor 
for the Watson-Glaser Critical Thinking Appraisal 
varied from about -0.15 to about 40. 54. For the 
ACE test, loadings of items on the first centroid 
factor varied from about +0. 15 to 40. 54; whereas 
for the Principles test, loadings of items on its 
first centroid factor varied from about -0.20 to 
about 40.49. Table II shows the variance account- 
ed for by the first centroid factors. 

, In general, items having highest loadings on the 
first centroid factor for each test came from 50 
many different subtests andtherefore represented 
So many different abilities that it would have been 
difficult to find a label for these common factors. 
The a priori reasoning of the test makers, how- 
ever, which led to the grouping of as many as 
Seven items, namely, 38, 39, 42, 48 53, 55, and 
57, їп the Watson-Glaser test was confirmed. 

Since each of these common factors accounted 
for only a small portion of the variance, it was of 
little value in explaining the intercorrelations of 
test items within the test. Thus very little parsi- 
mony was obtained insofar as describing the in- 


ternal structure of each test in simple terms is 
concerned. 


Conclusions 


АП these findings indicate that only in rare in- 


TABLE II 


THE VARIANCE ACCOUNTED FOR BY THE FIRST CENTROID FAC TORS 
FOR EACH OF THE THREE CRITICAL THINKING TESTS 


Variance accounted for (in percent) Cumulative variance (in percent) 


Factor 
Watson-Glaser ACE Principles Watson-Glaser ACE Principles 

1 7.076 14.782 7.610 7.076 14.782 7.610 
2 3.148 3.601 2.890 10. 224 18.383 10. 500 
3 2.470 3.527 2.877 12. 694 21.910 13.377 
4 2.171 3. 347 2.768 14. 865 25.257 16. 145 
5 2.022 2.928 2.730 16. 887 28.185 18. 875 
12 1. 539 2. 091 2.319 28. 694 45.222 35. 876 
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stances was the a priori reasoning of the test 
makers regarding grouping of items con firmed. 
This suggests that all items within a subtest do 
not measure the same skills or abilities, and 
therefore do not measure the skills or abilities 
they were intended to measure according to sub- 
test titles and/or the manual accompanying the 
test. One might, then, conclude that the tests are 
poor tests and should be replaced. The low inter- 
correlations of test items and of total scores on 
the three tests lend support to this conclusion. 

On the other hand, perhaps the tests are good 
tests, and the critical thinking process involves а 
large number of unique abilities and ite m s of 
knowledge. The small portions of the variance 
which the first, and strongest, centroid factors 
accounted for, serve as evidence to support this 
conclusion. 

The author feels that the evidence is not con- 
clusive that the tests are good, nor is it conclu- 
sive that the tests are poor. Hence the author 
takes the position that the tests could be improved. 
More might have been learned about the internal 
structure of the tests if: (a) a different way of 
scoring the answers had been used (3), for exam- 
ple, weighting the responses or revising the keys 
(4); (b) a favorable testing situation had been en- 
sured; (c) other subjects had been used, for in- 
stance, scores of subjects in the experim ental 
group might be analyzed separately from those in 
the control group, or the sample us ed might be 
selected more carefully by casting out those whose 
responses on the Watson-Glaser test indicate the 
presence of a mental set (4); (d) control had been 
maximized when the Critical Thinking Project 
Committee set up the experiment; (e) the principal 
axis method of factoring had been used, and/or (f) 
a factor analysis had been made of the total scores 
for the subtests of each test instead of the individ- 

i cores. 
€ interesting to note that factor 
analysis of the items of three different tests pur- 

ing to measure critical th inkingabilities 
Pod only one weak general factor each. One 
Vondera visi the implications of this result are. 
Does critical thinking ability not resemble ped 
abilities in having a general fac tor? Oneas е 
this question because intelligence tests, tests 0 
psychomotor and physical abilities, performance 
tests and tests of occupational abilities, а11 have 
yielded a thoroughly establi shed general factor 
(within a given test) (10). It should be os med 
ed, however, that most of the results of experi- 
mental work in this field have been basedupon 
factor analysis of batteries of tests or sub te sts, 
not individual test items. Moreover, the finding 
here may be just a reflection of the low intercor- 
relation of test items, for afactor may be defined 
as a ‘‘construct which accounts for the objectively 
determined correlations between tests.. es a 
category ‘ог classifying mental or behavioural 


181 


performances, rather than entities in the mind or 
nervous system. ” (10) 

If one surveys research reports in the field of 
factor analysis of reasoning and intelligence tests 
(2, 5, 6, 7), one discovers the findings can be 
summarized as follows: (а) in all instances the 
researchers have been successful in isolating 
several first order factors; (b) in a few cases one 
or more strong second order factors have been 
extracted (8); (c) practically no information has 
been gleaned regarding any of the three critical 
thinking tests involved in the present study, ex- 
cept for one investigator’s finding of low reliabil- 
ity for the Watson-Glaser test (1). 

The factor analyses described in the present, 
study yielded, on the contrary, no strong centroid 
factors. Therefore, further investigations re- 
garding the characteristics of the subjects, test 
items, and critical thinking ability itself would 
seem needed. Two such worthwhile studies might 
be an investigation to determine whether a factor 
analysis of the scores on subtests yields the same 
results as a factor analysis of the scores on indi- 
vidual test items, and a factor analysis ofa smal- 
ler sample selected in such a way as to control 
more variables. E 
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CAN PROSPECTIVE teachers accurately de- 
termine with which items of the F scale (а mea- 
sure of anti-democratic potential) adolescents 
will tend to agree? Further, can they accurately 
determine with which items ofthe F scale adoles- 
cents will tend to disagree? If these prospective 
teachers do accurately predict adolescent re- 
sponses, what will this mean? If they do not ac- 
curately predict their responses, what will this 
mean? Іп other words, if there are differences 
between their estimates andthe way adolescents 
actually do respond, what willthese differences 
mean? 

Scodel and Mussen (1) reported thatlow Е scale 
Scorers were more accurate in estimating high F 
scale scorers responses to the measure than were 
high scorers in estimating thelow scorers re- 
sponses. Cohn (2) reportedthata group of college 
students successfully faked r esponses to the F 
scale, implying that they co uld estimate with 
some degree of accuracy the responses of certain 
kinds of persons to the measure. 


The Procedure 


questions stated above, the au- 
the F scale to 104 high school 
an and Alabama and to 69col- 
achers College of a 


To answer the 
thor administered 


students in Michig: 1 
lege students enrolled in a Te 


Pennsylvania university. | | 
Each high school student from Michigan was 


matched with one from Alabama on the bases of 
age, sex, and grade in $C hool, making 52 pairs 
тай. The mean age of these two groups was 
16.38 years, and each group had 22 girls and 30 

S. 
м2 college group consisted of 38 boys and 31 
girls enrolled in courses inthe professional se- 
quence leading to а Bachelor of Science degree in 
education. The mean age of this group was 22.50 
years. All of the students but four intended to 
teach in secondary schools upon graduation. Of 
the four who did not intend to teach, three were 


preparing for the ministry and one for social work. 

The responses of the high school students were 
handled in the following manner: Agreement or 
disagreement with individual items was recorded, 
i.e., any item which received a plus mark (+1+2 
+3) was recorded as agreement, whereas any item 
which received a minus mark (-1-2-3) was re- 
corded as disagreement. The percent of each 
group who agreed with each item was determined 
and the various items were thenlisted in rankor- 
der, according to agreement, and these rank or- 
ders were compared (3). 

The ranking of the items for the two groups of 
high school students was not identical (there was 
not a perfect correlation for every item), although 
there was a large area of agreement. Theauthor 
observed that although the proportion of the two 
groups who agreed with any particular item dif- 
fered, in general both groups tended to accord ap- 
proximately the same value to most of the various 
items as they related to the whole. That is, even 
though 75% of the Alabama group agreed with item 
13 and only 56% of the Michigan group agreed, if 
the percent of agreement for all of the various i- 
tems were given a rank order for both groups, 
both the Michigan and Alabama groups accorded 
this particular item approximately the same rela- 
tive position, viz., thirteenth. There were some 
variations in this relative rank order between 
groups, but the general pattern seemed to be quite 
similar. In fact, only four items differed more 
than four positions between the two groups, 
whereas 23 items were accorded approximately 
the same value (i.e., differed four or less posi- 
tions) in the overall hierarchy of values which 
seemed to be demonstrated by a complete ranking 
of all the items. 

For purposes of this study, however, the re- 
sponses of the adolescents from both groups com- 
bined was considered, and the final ranking of all 
the items was for all 104 high school students. 
The discussion above was designed to illustrate 
that although the respondents came from different 
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cultural areas, the general pattern of agreement 
and disagreement was quite similar. 

The responses of the college group were han- 
dled in the following manner: After responding to 
the F scale in the usual way (in order to ins ure 
familiarity with all items), they were directed to 
mark those three items with wJfich they felt high 
School students would be most likely to agree. 
Further, they were then directed to mark those 
three items with which they felt high school stu- 
dents would be most likely to disagree. 

Any item estimated as an agreement was given 
one plus point, and any item estimated as a disa- 
greement received one minus point. The total 
value for each of the 27 items was determined a- 
rithmetically, and then all of the items were 
placed in a rank order according to the coll ege 
students’ estimated agreement through disagree- 
ment. 

Finally, the actual rank order for the Е scale 
items by the high school Students was compared 
with the college students' estimate of high school 
students’ rank order by inspection. Those items 
which differed less than four positions were con- 
Sidered as correctly estimated, whereas those 
which differed more than nine positions were con- 
Sidered as incorrectly estimated. That is, if the 
relative ranking of the college students’ estimate 
of the high school £roup were less than four posi- 
tions apart, the items were considered as having 
been correctly estimated; if they were more than 
nine positions apart, they were considered as in- 
correctly estimated. 


The Results 


The results of these procedures are recorded 
in Tables I and II. TableI shows the ranking of 
those eight items which the prospective teachers 
correctly estimated. These data seem to indicate 
that in respect to these items the prospective 
teachers correctly perceived adolescent values, 
as values are reflected in a hierarchy which is ap- 
parent in any ranking according to agreement. 

Table II shows those items on which prospec- 
tive teachers incorrectly estimated how high 
school students would agree or dis agree. These 
data seem to indicate that this group of prospec- 
tive teachers seriously erred in estimating adol- 
escents’ response to these particular twelve items 
of the F scale. 


Discussion of Results 


It seems that this particular group of prospec- 
tive teachers recognized that adolescents appear 
to have faith in themselves toget things done, that 
science will not solve allproblems, and that there 
are evidently times when high school youngsters 

t to be left alone, to have secrets, and to have 
ке Ба things which are private and not known to 


other persons. 

Further, this group of college students who plan 
to teach was correct when they thought high school 
students would not accept the idea that "familiarity 
breeds contempt, ” that persons must suffer to 
learn, or that “some people are born with an urge 
to jump from high places. ” 

Finally, they also recognized that adolescents 
apparently are not generally agreed upon the idea 
that there will always be wars or that people must 
be careful in groups, since these high school stu- 
dents tended to accord these particular items. a 
value about midway in their overall pattern of a- 
greement-disagreement. 

These data mean, to this author atleast, that 
for the eight items listed in TableI, this particular 
group of prospective teachers rather accu rately 
estimated adolescent response. They have some 
idea as to how high school students think and feel, 
atleast as regards the ideas inherent in this par- 
ticular set of items. 

Concerning the differences apparent in Table II. 
there are probably several interpretations pos- 
sible. Some which this author feels may be impor- 
tant are discussed below. Many of these have been 
projected to their logical extrem e, and as such, 
may appear to go beyond the data. Theauthor 
feels that these projections, if not warranted, are 
at least permissable on the grounds that they may 


Serve to encourage further exploration into the 
area. 


know or feel one way (i.e. 
actually behave in an entir 


olescents' real behavior, which is observable, but 
then the question immediately arises: **Which is 
the important thing, how adol e scents feel or how 


TABLE I 


PROSPECTIVE TEACHERS' CORRECT ESTIMATES OF HOW HIGH SCHOOL 
STUDENTS WOULD RANK F SCALE ITEMS 


Item Number Item Actual High College Estimate 
School Ranking of H. S. Ranking 


2 No weakness or difficulty can hold us back if we have enough 
will power. 3 3 
3 Science has its place, but there are many things that can 
never possibly be understood by the human mind. 6 7 E 
ш 
18 Nowadays more and more people аге pryinginto matters that қ 
Should remain personal and private. T 5 B 
5 
4 Human nature being what it is, there will always be war and 
conflict. 13 11 
9 Nowadays when so many different kinds of people move 


around and mix together so much, a person has to protect 
himself especially carefully against catching an infection or 


disease from them. 16 18 
27 Familiarity breeds contempt. 20 19 
11 Some people are born with an urge to jump from high places. 21 20 
26 Nobody ever learned anything really important except through 

suffering. 27 25 
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TABLE II 


PROSPECTIVE TEACHERS' INCORREC T ESTIMATES OF HOW HIGH SCHOOL 
STUDENTS WOULD RANK F SCALE ITEMS 


Item Number 


Item 


Actual High 
School Ranking 


College Estimate 
of H. S. Ranking 


12 


17 


16 


22 


20 


15 


10 


24 


Obedience and respect for authority are the most im- 
portant virtues children should learn. 


Young people sometimes get rebellions ideas, but as 


they grow up they ought to get over them and settle 
down. 


Someday it will probably be shown that astrology can 
explain a lot of things. 


There is hardly anything lower thana person who does 


not feel a great love, gratitude, and re Spect for his 
parents. 


What youth needs most is strict disc ipline, rugged 
determination, and the will to work and fight for fam- 
ily and country. 


If people would talk less and work more, everybody 
would be better off. 


A person who has bad manners, habits, and breeding 
can hardly expect to get along with decent people. 


When a person has a problem or a wor гу, it is best 
for him not to think about it, but to keep busy with 
more cheerful things. 


Most of our social problems would be solved if we 
could somehow get rid of the immoral, crooked, and 
feeble-minded people. 


People can be divided into two distinct classes, the 
weak and the strong. 


An insult to our honor should always be punished. 


The business man and tne manufacturer are much more 
important to society than the artist and the professor. 


12 


17 


19 


23 


25 


22 


26 


27 


24 


23 


16 


26 


22 


14 


12 
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behave? Certainly there are arguments for both 
sides of any such question. 

Another criticism of thedatainthis study may 
be that the samples are not ‘‘representative, " or 
at least that the group of college students from 
Pennsylvania need not necessarily be expected to 
know how high school students from Michigan and 
Alabama would feel regarding these items of the 
F scale. Their estimates might actually be cor- 
rect for a group of high school 5 tudents from 
their own geographical or cultu ral vicinity, for 
example. This is, of course, an important point, 
but one which can only be res olved with further 
study. One might infer that since the Michigan 
and Alabama samples were actually quite similar 
in their relative agreement with the various items 
of the measure, Pennsylvania high School stu- 
dents would probably closely appro xim ate this 
pattern of agreement-disagreement too, but this 
could never be more than speculation, however 
carefully concluded. 

However, disregarding the limitations for the 
time being, if these differences really do exist, 
a very real question is **Why?" Why do adoles- 
cents feel one way, and why do college students 
think they feel another way? Arethe prospective 
teachers learning the wrongthings in their college 
courses and/or from the media of mass commu- 
nication, radio, press, television, .etc.? Fur- 
ther, are the high school s tudents ac tually as 
**good"' as an inspection of the data seem to indi- 
cate? Do prospective teachers really think that 
high school students are as “рай” as they seem 
to think if one examines their estimates of high 
school students’ responses? Then, if they actu- 
ally do think that high school students are that 
“рай,” why are they going into teaching? What 
are their motives regarding entering a profession 
which will entail working with whole groups which 
they evidently feel are essentially ‘‘bad? | 

Considering all of these factors, the differen- 
ces which seem to be apparent in Table II will be 
discussed in light of the opportunities they sug- 
gest for further research. In other words, there 
seem to be some factor or factors involved here 
which result in certain differences which have 
manifested themselves in the data con tained in 
Table II. However, since ће data and the devices 
employed in this study have certain definite limi- 
tations, the author feels that each of these various 
areas deserves further extensive investigation. 


Suggested Research 


Do adolescents really feel that “obedience and 
respect for authority are the most important vir- 
tues children should learn?" Does this mean that 
they want, like, and even expect di r ection, con- 
trol, and limits? Further, do prospective Шалы 
ers feel that high school students are really ‘‘au- 
thority rebels, >> that they dislike control, and that 


they do not want to show respect for authorities 
of any kind, as the data in this particular study 
seem to imply? 

Are adolescents really concerned about people 
of all kinds? Do they really feel that people are 
important, as these data seem to indicate? And 
do college students who intend to teach actually 
think that high school students will want to ‘‘get 
rid ой” certain groups, even those persons who 
might be conveniently classed as ‘‘undesirables?”’ 

Finally, do these data mean that high school 
boys and girls are not aggressive, do not follow 
an “еуе for an еуе” kind of philosophy, and will 
not demand redemption for wrongs committed a- 
gainst them? It this the counterpart of the ‘‘love 
and respect” апа ‘‘all people count" ideas which 
seem to emerge from their responses to the ideas 
inherent in the several items as they agreed or 
disagreed with them? Also, do prospective 
teachers really think that high school students 
function on a strict ‘‘one for one’’ basis, punish- 
ing insults and rejecting their parents, as might 
be inferred from their estimates regarding ado- 
lescent responsesto the various items? 


Conclusions 


Obviously there are many conclusions one 
might draw from these kinds of data. Four things 
seem especially important to this writer. First 
the general interpretation of the data seem to in- 
dicate that high school students’ values, as re- 
flected indirectly in a ranking of the various items 
of the F scale according to their agreement, are 
positive. They seem to think, inother words, 
that “тап is basically good. "' 

Second, it would seem that by and large this 
group of prospective teachers' estimates of high 
School students is negative. They seem to think, 
in other words, that high school students think 
“тап is basically bad." 

Third, although there is a rather sizeable area 
of values which the prospective teachers correct- 
ly estimated, in general their incorrect estimates 
seem more Significant and more profound by vir- 
tue of the very items involved in error. Said an- 
other way, this group of young people, who not 
only hope but are seriously planning and working 
toward a teaching career, have an essentially in- 
accurate perception of what adolescents are actu- 
ally like. 

Finally, two questions beg of further study. 
Are the differences which areapparent here real- 
ly differences? Second, if they do exist, why do 
they? 


Summary 


Two groups of young people, 104 high school 
students from Michigan and Alabama and 69 col- 
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lege students enrolled in a Teachers College ina 
Pennsylvania university were measured with the 
F scale. The way the high school students agreed 
and disagreed with the various items of the mea- 
sure was compared to the way the coll ege stu- 
dents thought high school students would agree 
and disagree. The prospectiveteachers correct- 
ly estimated adolescent responses for eight of the 
27 items, but incorrectly estimated their  re- 
sponses for 12 items. Several problems were 
posed for further investigation. 
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PERSONALITY TRAITS ASSOCIATED WITH 
MATHEMATICAL ABILITY: 
A PLEA FOR RESEARCH 


ROBERT H. RIFFENBURGH 
University of Hawaii 


IN RECENT years increasing attention has 
been given to inadequacies in training of mathe- 
maticians in our society. With ludicrous fre- 
quency one hears it said that the student in ques- 
tion does not have а ‘‘mathematical mind." What 
is this mathematical mind? Does it exist? If so, 
early recognition would permit proper attention 
to promising individuals and could reducethe cost 
and frustration of attempting to train the untrain- 
able. И the mathematical mind does not exist, 
revision of our attitudes and instr uction is just 
Е aren of the pertinent literature reveals that 
existing studies give disappointingly narrow and 
mostly negative answers to the above questions. 

In this paper, a mathematical mind is assumed 
to be an innate phenomenon, unrelated to basic or 
general intelligence, * existing prior to mathemat- 
ical training, which enables the individual posses- 
sing it tolearnand perform mathematics with fa- 
cility. The name could well be ‘‘mathe matical 

onality. '' 
a consideration of the subject by var- 
s mathematicians, psychologists, and educa- 
that the following five factors of 
be postulated: 


iou 
tors suggested l 
the ability to perform mathematics 


general intelligence 
past training 
general maturity 
attitude toward an є 
а mathematical personality 


d interest in mathematics 


SUE comes 


Prior studies add support to some of these 
postulates. Cattell (3) performed a factor analy- 
sis on results of Army Alpha Intelligence Tests 
and the verbal and mathematical se ctions of the 
Graduate Record Examination. He found the fac- 
tors (a) general ability (similarto 1), (b) charac- 
ter integration (may be related to 3), and (c) 
trained mind or length of education (similar to 2); 
he also found some evidence of ‘‘cleverness, an- 


*Witness the many quite intelligent social scientist 


alytical mind, ” which might be related to апу of 
1, 2, 3, or 5. Barakat (1) gave a set of mathe- 
matics tests to youths and performed a factor an- 
alysis onthe results. He found the factors (а) gen- 
eral intelligence (same as 1); (b) group factor for 
mathematical ability (which from his description 
dependson pasttraining, 2); (c) verbal; (d) visuo- 
spatial factor. (c) and (d) might relate to any of 
1, 2, 3, or 5. The reader is reminded that the 
naming of factors obtained from factor analysis is 
somewhat arbitrary. 

In order to investigate the existence or non- 
existence of factor 5, it is desirable to eliminate 
by some means or other the first four factors and 
examine what remains. Five general approaches 
have occurred to the author. 

Longitudinal Studies— The longitudinal study 
promises the most information of all studies, but 
presents by farthe most difficult problems. Many 
children would be followed from an early age to 
adulthood with intermittent testing throughout. As 
adults, those doing wellin mathematics could be 
compared with those doing poorly on the basis of 
heredity, continuous environment, and psycho- 
logic measures of all sorts. 

Pros: Information would be more complete, 
more certain, and better controlled than in other 
approaches. Given large enough samples, intel- 
ligence could be equated, subjects could be tested 
prior to anytraining, training could be controlled, 
and comparisons could be made in maturity. Thus 
factors 1, 2, 3, and to some extent 4, could be 
eliminated from consideration. 

Cons: The obvious difficulties are the length 
of time needed, the enormous cost involved, and 
the problem of obtaining and retaining subjects. 
Also of importance is the possibility that the con- 
trols themselves—attention to personality and 
performance, frequent testing, etc., —may exert 
an influence upon some members of the group. 

There have been no studies to date using this 
approach. 


s who claim they have “по mathematical mind. '' 
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Child Studies— The child study approach would 
involve equating for intelligence and testing and 
comparing a large sample of childrenon the basis 
of personality tests and some mathematical 
device. 

Pros: There will have been no mathematical 
training andthe childrens' attitudes will not have 
been formed as yet; thus factors 2 and 4 are con- 
trolled effectively. 

Cons: If maturity, factor 3, exists as a nec- 
essary condition for mathematical ability, and 
this has appeared to be the case in many in- 
stances, this method is useless. Furthermore, 
obtaining ог devising a measure for children which 
will be associated with adult performance in math- 
ematics is requisite and a very difficult task. A 
language factor is present and communication is 
difficult. Personality and intelligence measures 
for young children are not remarkably reliable. 

There have been no studies to date using this 
approach. 

Adult Studies— Ап adult Study would involve 
(a) testing a sample of adults equated for intelli- 
gence, attitude, and past training, (b) assuming 
the maturity condition present, and (c) compar- 
ing results for those competent mathematically 
with those not competent mathematically. 

Pros: Adults areeasier to measure than chil- 
dren; maturity is much more likely to be present 
than in younger groups. 

Cons: The maturity condition must Stillbe as- 
sumed to be satisfied, or some measure of ma- 
turity must be made and only individuals satisfy- 
ing the maturity condition be chosen; if this ma- 
turity involves ‘‘mathematical maturity," such а 
measure doesnotnowexist. Equating groups for 
intelligence and attitude may be done to some ex- 
tent through existing ps y chologic measures, but 
these measures have limitations; equating for 
past training would be extremely difficult. Fur- 
thermore, even if the mathematically able were 
foundto have traits different from the mathemat- 
ically unable, there arises the question: are the 
individuals able because of these traits or have 
they acquired some of these traits due to their 
abilities and professions? : | 

There have been no studies to date using this 

h. 
AP eminent Меп”, Studies—Here the personali- 
ties of eminent теп” in the field of mathematics 
would be investigated in an effort to determine 
characteristics unique to them; this may involve 
comparison with **normal" men or with eminent 
i fields. 

us Cen peculiar to mathe- 

tical competence exist, the subjects from this 
aet be safely assumed to havethem. Thus 
ira ped differential results would be much 
2. f the non-existence of such 
stronger evidence о imilar absence in 
personality traits than would similar 


other types of subjects. 


Cons: Two questions are posed. Would the 
eminent mathematicians have been as eminent if 
they had gone into another field? Do the individ- 
uals follow their professions because of their per- 
sonalities, or have they acquired some of these 
traits due totheir professions? Also, if compar- 
ison is made with ‘‘normal, ” factors 1, 2, and 4 
may be expected to be present. If comparison is 
made with groups eminent inother fields, individ- 
uals in the other fields may be or may be poten- 
tially mathematically competent as well. 

A few studies related to this approach have been 
made by Roe (5, 6, 7), but mathematics was not 
the primary interest and no results relating to 
mathematics were given. Roe compared groups 
of scientists, viz., physical, biologic, psycho- 
logic, and anthropologic scientists, on the basis 
of the Rorschach Test. Some results were found 
and were expressed as differences in frequency 
of various types ofresponses. The interpretation 
was generally left to the reader, apparently for 
the reason that interpretation is not unique and will 
vary from one psychologist to another. Roe also 
investigated a group of the very ''eminent"' in sev- 
eral fields of science and gave ‘‘case histories. "' 
The results may provide ideas as to traits to in- 
vestigate, but little more. 

Youth Studies—A youth study would be essen- 
tially a compromise between the child and adult 
studies, possessing some of the advantages and 
disadvantages of each. It would involve sampling 
from youths of high-school or college age. Firmly 
formed attitudes and effects of past training are 
less than inadults but more than in children; ma- 
turity would be more complete than in children 
but less than in adults, The intelligence factor 
could be largely eliminated by comparing, say, 
groups of college students in the same curriculum 
where one group was composed of A-average stu- 
dents receiving A in mathematics courses and the 
other of A-average students receiving F in mathe- 
matics courses. 

| Ргоз: Тће Subjects would ђе readily available, 
since most researchers are affiliated with univer- 
sities. Also the testing problem could be simpli- 
fied by the universities’ testing services, 

Cons: Some of the dis advantages of both the 
child and the adult studies would be present. 

Only one study using this approach has been 
done; the results were negative. The procedure 


ematically to any degree which could affect their 
In order to reduce the effectsof 
g and attitude factors, the sample 
was chosen from among engineering freshmen at 
one state school. In order to atte mpt to equate 
for intelligence, the groups were chosen from stu- 


— — 


dents in the upper half of their class; one group 
had received A in college algebra, the other F. 
The personality test posed a problem. It was 
necessary to eliminate all factors but 5 from the 
measure. (Any attitude resulting from natural 
proclivity could be thought of as 5 rather than 4 
and is desired anyway.) Of personality measures 
available to the author, all types but projective 
techniques may be affected by intelligence or at- 
titude. Of possible projectivetechniques, it was 
felt necessary to choose one producing quantifi- 
able results in order to obtain reproducible re- 
sults susceptibletostatisticalanalysis. Burgess 
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Mean Mean 
Score for Score for 

"TO n 
Plate Students Students t* 
I 1. 86 1. 24 1. 42 
п ‚23 20 .02 
ш . 09 - .14 . 10 
IV 1. 09 1.14 «14 
У - .41 - .90 1.78 
VI - .05 - .29 .12 
VII - .45 0. 00 .85 
VIII - .14 - .41 .45 
IX -1.50 - .81 1. 80 


(2) has indicated that quantificationand statistical 
testing of the Rorschach is inadequate for differ- 
entiating academic deviates, and that the Rosen- 
zweig Picture Frustration Study and the Minne- 
sota Multi-Phasic Inventory group form are not 
at all suitable. She recommends the Thematic 
Apperception Test, but that technique prese nts 
serious problems inquantification. Furthermore, 
allthe mentioned projective techniques lack 
unique interpretations; different psychologists 
often find different results. A number of lesser- 
known and foreign projectivetechniques were in- 
vestigated and it was decided that the little-known 
Polychrome Index (4, 8, 9, 10) would most nearly 
satisfy the requirements. This index is brief and 
completely quantifiable. ТЕ has been shown (8, 9) 
to be unrelated to intelligence; it appears safe to 
assume that it isunrelatedto past training or at- 
titude toward mathematics. This index may not 
be, however, unr elated to the maturity factor, 
but in fact has been shown (4) to relate closely 
to certain aspects of ‘‘social maturity. 15 

For the Polychrome Index, nine plates con- 
taining various color combinations are presented 
and the subject is asked to choose the three he 
likes most (ordered), which are then weighted 3, 
2, 1, andthe three he likes least (ordered), which 


are weighted -3, -2, -1; the three not chosen are 


weighted 0. 

The Polychr 
standard fashion to 1 
men at the Virginia 
in college algebra. 
scores for 22 students | 
and the 21 receiving “Е” were iso 
pared by t tests. 

The table shown О 


ome Index was administeredinthe 
11college engineering fresh- 
Polytechnic Institute enrolled 
At the end of the term the 
receiving the grade “А” 
lated and com- 


nthis page gives the mean 
scores for A students and F students for each 
plate on the Polychrome Index; it gives the t's 
computed for each plate comparing the means of 
the A and Е students. It is seen that no t is sig- 
nificant. Е 

There are three possible interpretations of the 
negative results given in the table: 
o “mathematical personality. ”’ 


а) There is n 
) **mathematical 


b) There are several different 
personalities. i 


*No t's significant. 


c) There is а ‘‘mathematical personality," but 
the investigation was not adequate to find it. 


We may conclude that here is presented some 
small but certainly not conclusive evidence that 
there is по “mathematical personality. " If re- 
peated studies should give similar findings, we 
may develop some confidence that there is no 
mathematical personality and consequently no 
«та ћетан са] mind. ’’ 


Summary 


The question, *Is mathematical ability in- 
nate?" is becoming of urgent importance in our 
contemporary culture. The training of competent 
mathematicians would be markedly facilitated by 
finding the answer to this question. No research 
of import or value has been done that provides in- 
formation about this problem. 

This paper presents a plea for research on this 
subject. It presents five approaches to such re- 
search, discussing the advantages and disadvan- 
tages of each and mentioning the few studies that 
have bearing upon thefield. Onesuch study, done 
by the author, is given inthe preceding section of 
of this paper. 
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THIS STUDY was concerned with isolating by 
centroid factor analysis the inde pendent factors 
present in the Iowa Tests of Educational Develop- 
ment (ITED), and certain other tests and subtests; 
and to identify and describe such factors on the 
basis of face and construct validity by rotating 
them orthogonally to simple structure. A total of 
15 variables in the form of tests and subtests were 
included in the factor analysis, seven of which 
were not a portion of the ITED battery. 


Tests Utilized -- Achievement Area 


All of the tests and subtests included inthis 
study were a portion of the regular test battery 
administered for guidance purposes to all enter- 
ing 9th grade (freshmen) students in Phoenix high 
schools. 

Iowa Tests of Educational Development X - 35 
ITED). These tests were administered during 
freshmen week (immediately prior to the opening 
of school in the fall) by guidance counselors in the 
various guidance departments of the respec tive 
high schools. Eight of the tests from this battery 
were included in the factor analysis: 1) Basic So- 
cial Concepts, 2) Natural Science Background, 3) 
Correctness of Expression, 4) Quantitative Think- 
ing, 5) Interpretation of Social Studies, 6) Inter- 
pretation of Natural Science, 7) Interpretation of 
Literature, and 8) Vocabulary. The Standard 
Scores were used, and they were compiled from 
national first semester freshmen norms for the 
1957-58 school year. : 

Cooperative ‘English-R eading Comprehension 
Cl = С) Lower Level. This test with its several 
parts (Vocabulary, Speed, and Level) was admin- 
istered in the same manner as the ITED. Scaled 
standard scores were utilized based on national 


norms provided in the test manual. 


Tests Utilized- -Multiple Aptitude Area 


Differential Aptitude Test Battery (DAT). This 


battery was administered by staff members and 
teachers of the 12 elementary school districts 
that channel students into the Phoenix Union High 
Schools and Phoenix College System. Generally, 
the tests were administered during the first half 
of the eighth grade school year (1956-57). Four 
of the tests from the DAT were included in the 
factor analysis: 1) Verbal Reasoning, 2) Numeri- 
cal Ability, 3) Language Usage-Spelling, and4) 
Language Usage-Sentences. Raw scores were u- 
tilized. 


Tests Utilized--Intelligence Area 


California Test of Mental Maturity, Advanced, 
'57 S-Form (CTMM). This test was administered 


during freshmen week to all entering 9th grade 


students by the guidance counselors of the respec- 
tive high schools. Both parts of the CTMM were 
included in the factor analysis, and in terms of a 
raw score for each: 1) Language Scale and 2) 
Non-language Scale. 


Group Utilized 


There were 4,776 9th grade entering students 
for the 1957-58 school year, and the 124 students 
selected for this study were screened onthe basis 
of a two-fold process: 1) random selection, and 2) 
elimination of non- or poor readers. 

Every fifth name from an alphabetical listing 
of entering 9th grade students ineach of the seven 
high schools was included for the initial portion 
of the study (20 percent sample of total group). 
This group was then further reduced by a second 
selection of every fifth name (20 percent sample 
of the initial 20 percent sample). This group was 
then further screened to eliminate those individu- 
als with a Cooperative Reading stanine score of 
three or below. This elimination of poor readers 
was accomplished to insure that all individuals 
included in the factor analysis study (the 124 in- 
dividuals used for study) were capable of reading 
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the tests included. 

А comparative examination of mean test 
Scores for intelligence and reading indicated that 
the average for the students in the final experi- 
mental group was significantly higher than the 
average for the total freshmen group. 


Findings 


Six separate and independent c en troid factors 
were extracted from the 15 different tests and 
subtests contained in this study. Each of these 
six factors has been identified on the basis of the 
significant factor loadings (values of .300 or bet- 
ter considered to be statistically significantat the 
one percent level). 

Factor I--Correctness of Expression-English. 
This factor was relatively pure in terms ofthe 
significant loadings pres ent, and with the Cor- 
rectness of Expression Test of the ITED being the 
most representative and cha racteristic variable 
in the study. Other significantfactor loadings 
were: Language Usage-Spelling (. 569), Interpre- 
tation of Literature (. 402), and Language Usage- 
Sentences (. 391), see Table П. Each of these 
tests have face validity thatagrees with the defin- 
ed factor, and they all have high agreement with 
each other. 

Factor II- -Intelligence-Language and Non-Lan- 
guage. This factorappearedto be relatively pure 
also, in that all four variables (tests) having sig- 
nificant loadings were from either the aptitude or 
intelligence area. The fact that both parts from 
the only intelligence test included in the analysis 
(C TMM) had significantloadings adds credence to 
the CTMM for assessing this factor. Other tests 
which had significant loadings on this factor were 
as follows: Language Usage -Sentences (.50 9), 
and Numerical Ability (. 384). 

Factor III--Quantitative. This factor did not 
appear to be factorially pure in terms of the face 
validity for the tests having significant loadi ngs. 
The fact that both the Quantitative Thinking test 
of the ITED and the Numerical Ability test of the 
DAT obtained significant loadings ad ds credence 
to referenced identity (these loadings were.554 
and .373, respectively). The first of these two 
variables is recommended for describing the fac- 
tor, i. e. , Quantitative Thinking. 

It is of interest to note that the other two tests 
having significant loadings onthis factor were: 
Language Usage-Spelling (513), and pe ce gea 
of Expression (.427). The implication is that ef- 
fective quantitative performance entails some as- 

competency, andthis may be true 

ect of language p Е 2 
Б written problems аге included in the tests. 
wr code IV--Natural Science. This factor was 
factorially pure in terms of significant factor 


loadings, and the Interpretationof Natural Science 
test from the ITED ко" *he only variable 
having significant weight (. 414). 

Factor V--Reading Competency. In spite of 
extensive rotations, simple structure was not ob- 
tained for this factor, and it could not be consid- 
ered to be factorially pure in any sense ofthe 
Statistical concept. In terms of face validity for 
reading competency, the Interpretation of Social 
Studies (.857) from the ITED, and Cooperative 
English- Reading Comprehension (.712) are re- 
commended for the identification of this factor. 
The effective reading function of materials on the 
high school level obviously involves many of the 
variables included in the various testsof this 
study. 

Factor VI--Basic Social Studies. This factor 
was factorially pure interms of significant factor 
loadings, and the Basic Social Studies test of the 


ITED was the only variable that had Significant 
loadings (. 332). 


Summary 


This study was concerned with is olating by 
centroid factor analysis the in dependent factors 
present in the Iowa Tests of Educational Develop- 
ment (ITED) and certain other tests and subtests, 
all of which form a portion of the 9th grade guid- 
ance test battery of the Phoenix Union High 
Schools and Phoenix College System. Sixcentroid 
factor loadings were extracted, and five of these 
were rotated to simple Structure orthogonally. 
These six factors were identified as follows, and 
the indicated tests were recom mended for their 
assessment in the Phoenix Union High Schools: I- 
Correctness of Expression-English (Correctness 
of Expression from ITED); II-Intellig enc e-Lan- 
guage and Non-language (California Test of Mental 
Maturity); III-Quantitative Thinking (Quanitative 
Thinking Írom ITED); IV-Natural Science (Inte r- 
pretation of Natural Science from ITED);V-Read- 
ing Competency (Interpretation of Social Studies 


from ITED); and VI-Basic Social Studies (Basic 
Social Studies from ITED). 
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PREVIOUS STUDIES of young children's house 
drawings have suggested the possibility of using 
these as a readiness test for primary school. 
Beck (1955) and Markham (1954), for example, 
found differences in the drawings of five- and six- 
year-olds which seemed to differentiate between 
dull and superior children. The pres ent study 
was undertaken to determine if any of these char- 
acteristics, easily and quickly obtainable from 
entering first-graders, are related to first-grade 
achievement. 


Method 


Subjects. The subjects consisted of the entire 


first-grade populations of West Frankfort and 
Benton, Illinois, two communities loc ated about 


seven miles apart. There were twelve first-grade 
classes, but the data from one of these was unduly 
incomplete and therefore was not used in the pre- 
sentanalysis. The number of subjects r e ported 
herein is 214. All Ss were white, there being no 
in either community. | 
The teachers were well briefed 
d all tests were administered by 
ber, the California T Foe 
ity (CTMM) was given an e house 
каш obtained. In late December, E. 
Haggerty-Olsen-Wichman ner И с а 
HOW) were complete ers, 
BUB e of Ае following spring, ту 
School Achievement Test-PrimarylBattery 


was given. 

The Drawings. 
vidual written and verb 
ministration and ROT of 

scoring reliability, | 
Eton with the teachers to expl ain the task to 
them and to clarify the meaning of the various 


Ma EO 
ill be found at the end of the article. 


negroes 
Procedure. 
= 
on the project апі 
them. In Septem 


Each teacher was given indi- 
al instructions for the ad- 
the drawings. To in- 
'one of the authors (HS 


*Footnotes W 


characteristics upon which the drawings were to 
be checked. 

At the time of administration, theteacher gave 
each child in her class a sheet of plain white paper 
7x8.5 in. (a half sheet oflegal-size paper), 
number two pencils and erasers. She was to see 
that there were no pictures of houses visible 
which the children could copy, and that each child 
had his paper placed with thelong edge horizontal 
to his line of vision. She then gave the following 
directions: ‘‘You all have paper and pencils and 
we are going to draw a house. Drawthe very best 
house you can. I want to see if you can draw bet- 
ter houses than the other children did. '' 

The drawings were scored simply on the pres- 
ence or absence of fifteen characteristics which 
previous research and experience indicated might 
be related to developmental level. Seven of these 
were “перайуе” (indicators of ‘‘immaturity’’) and 
eight were ''positive" (indicators of “greater 
maturity"), relative to theperformance of the av- 
erage six-year-old. These indicators were as 
follows: 


Negative Characteristics 


1. Omission of more than one essential detail 
(roof, wall, door, window, or chimney). 

2. Poor proportion (e. g. door wider than high, 
house that looks like a tower. ) 

3. Poor motor coordination (e. g. lines forming 

walls are wavy or jagged, corner lines over- 

shoot each other). 

Ап unrecognizable drawing. 

A recognizable but bizarre-appearing drawing. 

Transparencies (showing details behind solid 

walls--the ''glass-house"' effect. 

7. Poor organization (e. g. windows not in line 
horizontally or vertically, or random place- 


о сл > 
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ment of a door in the center of a wallinstead 
of at the base. 


Positive Characteristics 
Posiuve ne сы 


1. Two walls instead of one. 

2. Three or more windows. 

3. Correct alignment of windows and doors. 
4. A window in the attic. 

5. Two-dimensional roof. 

6. Door knob. 

7. Panes or curtains in the windows. 

8. Door panels. 


Each drawing was scored by the administering 
teacher and one of the authors (HSB) who had 
used such drawing tests extensively. In addition 
to the fifteen individual check items, two addition- 
alscores were obtained by summing the number 
of positive and negative checks. 


Analysis of Data 


АП of the scores thus obtained, plus the chron- 
ological age of each subject, were put into a 43- 
variable correlation matrix with the 214 subjects 
from the eleven classes combined. This matrix 
was then factor analyzed by the centroid method, 
putting unities into the diagonal spaces. There 
were four rotations to simple structure using the 
oblimax solution (Pinzka and Saunders, 1954), 
rotating the first three, four, five, and six fac- 
tors respectively. All computations weredone 
on the University of Illinois high speed digital 
computor, Illiac. 


Results 


As determined by simple analyses of variance 
the eleven subgroups were not significantly dif- 
ferent on the objective measures, so all of the 
subgroups were combined into one largegroup. 
The means and standard deviations for the objec- 
tive measures were {һеп аз follows: Age: 6. 47 and 
‚69; C TMM-total: 111. 62 and 18.97; ASA-total: 
1.06 (age equivalent) and .69; HOW-Scale А: 
15. 51 and 19. 60 (highly Skewed) and HOW-Scale 
В: 67.59 and 21.07. Since the drawings were 
rated by different teachers the reliability of the 
drawing scores from this source might be lower- 
ed in the combined matrix, but the resulting cor- 
relations suggest no particular gain or loss from 
this procedure. | 

Table I is the correlation matrix for the objec- 
tive test scores and ratings, age, and the teach- 
ers’ and psychologist’s summed scores for posi- 
tive and negative characteristics in the drawings. 
It should be pointed out that a high HOW score is 
‘pad’, i.e., indicative of a behavior problem. 
Almost all of the correlations in Table I are sta- 
tistically significant, the magnitude of correlation 


necessary for significance being given in thefoot- 
note to the table. 

The summed scores were almostinvariably 
more highly correlated with the objective measure 
than were individual items, but a goodly number 
of individual house-drawing items actually were 
significantly correlated with intelligence, achieve- 
ment and the HOW-scales. None were significant- 
ly correlated with age. While these correlations 
were in the proper direction, none of them had 
higher absolute value than about . 30. 

To determine if the drawing scores added to 
the correlation of . 51 between the CTMM total and 
the ASA-total, four multiple corr elations were 
computed, using each of the four summed scores 
as an additional predictor variable. One of these 
multiple correlations was .52 and the other three 
were .51. Clearly, the drawing scores as used 
here do not contribute anything to the prediction 
of achievement which cannot be obtained by the 
CTMM alone. 


Factor Analysis 


Fifteen factors were extracted from the cor- 
relation matrix, accounting Гог 74 percent of the 
total variance. The first six factors accounted 
for 22.4, 7.8, 5.4, 4.6, 4.5, and 4.4 percent of 
the variance respectively, cumulating to a total of 
49.1 percent. Each of the remaining factors ac- 
counted for only 2.3 to 3. 3 percent of the variance. 

For our purpose the six-factor rotation is the 
most useful since it gave one factor on which the 
СТММ scores loaded above .90 and another on 
which the ASA scores loaded at the same level. 
None of the four summed scores loaded higher 
than ‚18 on either of these factors, although one 
positive drawing characteristic (two walls instead 
of one) loaded . 41 on the “achievement” factor. 
There was no large common factor among all the 
items, as we might guess from looking at the pro- 
portion of the variance accounted for by the indi- 
vidual factors. In brief, then, this analysis re- 
vealed only a conglomeration of factors which had 
only one or two or three drawing items loading оп 


each, and with only a single item related to а- 
chievement. 


Discussion 


Objective Test Scores. In Table I, the inter- 
correlations of theobjective tests tend to run high. 
The positive correlation between intelligence and 
омеа was predictable, but the substant ial 

gative correlation between the ores 
and the HOW scores, and to ales све зна ре- 
tween the ASA and HOW was less expected. It iS 
likely that less intelligent students would be less 
adaptable in conforming to‘‘acceptable social pat- 
terns” at this age, but theinterpretation of the 
results may not be quite this simple. The teach- 


TABLEI 


CORRELATION MATRIX FOR OBJECTIVE TESTS ANE SUMMED DRAWING SCORES 
(Items 10-13 are teachers' and psychologist's summed scores for positive and negative drawing characteristics) 


1 2 3 4 5 6 T 8 8 10 11 12 
СТММ (language) 
СТММ (non-language) ‚65 
CTMM (total) .89 .90 
Age -.14 -.18 -.18 
ASA (reading) .42 .43 .48 .25 
ASA (numbers) E .41 .46 .35 .67 
ASA (total) .44 .46 . 51 .29 .87 . 81 
HOW (Scale А) -.42 -.39 -.46 .10 -.36 -.20 -.27 
HOW (Scale B) -.46 -.46 -.93 427 -.29 -.13 -.23 .68 
Теасһег (пер.) -.33 -.28 -.35 .00 -.22 -.27 -.24 .31 .27 
Teacher (pos. ) .24 .28 „ЭТ .05 „15 „= .14 -.27 -.26 -.59 
Psychologist (neg. ) -.39 -.37 -.42 .02 -.31 -.25 -.28 781 .23 .54 -.47 
Psychologist (роѕ.) .29 .26 .31 .03 .18 .20 „її -.27 -.29 -.57 .82 53 


Note: - for М = 214, а correlation of .14 or greater is significant at the . 05 level and a correlation of — — 
at the . 01 level of confidence. n of . 18 or greater is significant 


моча - Moda 


661 
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ers were familiar with the work of their students 
as well as probably knowing something of their C 
TMM scores. Consequently, their behavior rat- 
ings may have been flavored by this additional 
knowledge. The fact is, however, that the teach- 
ers did perceive the behavior of the students to 
be more troublesome in relationto intelligence. 
Drawing Ratings--Rater Reliability. Since the 
teacher or psychologist rated a given drawing on 
both positive and negative characteristics, and 
these characteristics were expected to be more 
ог less mutually exclusive in a given drawing, it 
is not surprising to find substantial negative cor- 
relations between the teacher's two sets of sum- 
med scores and the psychologist’stwo sets of 
summed scores (Table IJ. These are not overly 
high, however (-.59 and -.53), indicating a con- 
siderable number of both kinds of indicators in 
many of the drawings. A more important com- 
parison is that for the ratings between the two 
sources. The psychologist’s and teachers’ rat- 
ings were correlated +. 54 for sum m ed negative 
characteristics and +.82 for sum med positive 
scores. The latter correlation suggests a high 
level of rater reliability, particularly since there 
were eleven different teachersincluded in this 
correlation. Sincethepsychologist's correlations 
with the objective measures were almost exactly 
the same as the teacher's correlations, any dif- 
ferential Scoring Skills were not reflected; while 
pues PNE sources differed, they were equally 
Drawings and Test Scores. The summed 
scores were significantly correlatedinthe proper 
directions with intelligence and achievement, Un- 
fortunately, the correlations were nothigh enough 
to be of much use by themselves and the multiple 
correlations dispelled the notion thatthe drawings 
might add something significant to the correlations 
between intelligence and achievement. While 
some other carefully standardized d ra wing test, 
such as the Goodenough, might be useful for a- 
chievement prediction, we must conclude that the 
present test is not. Since this test had only a 
conglomeration of factors, with only one ofthe 
items loading on an **achievement" factor, nei- 
ther does its potential for this purpose look good. 
One might in fact question whether such a “test”? 
has any meaning at all. 


Summary and Conclusions 


The present investigation was concerned with 
the potential use of a house-drawing test for 
screening incoming first-graders. Theproblem 
was to determine if this device would have enough 
predictive validity to be us eful in Selecting out 
children who might have difficulty with school 
work, i.e., be low achievers. Over the School 
year an intelligence test, a behavior rating scale, 
а house-drawing test, and an achievement test 


were administered to 214 first-graders. The 
house drawings were scored on the presence or 
absence of seven “песайуе” characteristics (in- 
dices of *immaturity") and eight “positive” 
characteristics (indices of **greater maturity") 
by a child's teacher and by a school psychologist. 
A total of 43 variables (9 objective scores and 34 
house-drawing scores) were put into a correlation 
matrix which was factor analyzed and rotatedto a 
simple structure. The results were as follows: 

1. There was a positive relationship bet ween 
achievement and intelligence, and behavior was 
perceived by the teachers as being troublesome in 
relation to intelligence. R 

2. Many of the house-drawing characteristics 
were significantly correlated with intelligence and 
achievement, but these correlations were of low 
order, i. e., ranging in absolute value from .14 
to .35. 

3. Multiple correlations between the summed 
house-drawing scores, intelligence and achie v e- 
ment were no higher than those between intelli- 
gence and achievement alone. 

4. The factor analysis revealed a factor for 
‘intelligence’’ and one for ‘‘achievement’’, but 
only a single drawing characteristic loaded on ei- 
ther of these and there was no important common 
factor among the drawing scores themselves. 

5. It is concluded that the house-drawing test, 
as used here, is not suitable for a screening de- 
vice for selecting out entering first-graders who 
might have school achievement problems. 


FOOTNOTES 


- 


Director, Educational Clinic. 

2. The authors wish to acknowledge the assis- 
tance of Mr. Kern Dickman and members of 

the University of Illinois digital computing 

laboratory in carrying out the data anal ysis- 

Appreciation is also expressed to the superin- 

tendents of schools in the towns where data 

was collected, L. Goebel Patton and Н. Е. 

Boyd, and to their first-grade teachers. 

At the suggestion of Dr. Jum C. Nunnally. 


REFERENCES 


Beck, Harry S. “А Study of the Applicability of 
the H- T-P to Children With Respect to the 
Drawn House, ” Journal of Clinical Psychol- 
ову, 1955, 11, 60-03. сс 

Markham, Sylvia. “Ап Item Analysis of C hild- 
геп 5 Drawings of a House," Journal of 


_ Clinical Psychology, 1954, 10, 185-187. 
Pinzka, C. and Saunders, D. В. Analytic Rota- 
tion to Simple 


1 Structure Il: Extension to an 
Oblique Solution. Research Bulletin RB- 54- 
31, Educational Testing Service. Dated 
August 16, 1954. 


— ">. 


————— 2 


ү 


JOURNAL OF EXPERIMENTAL EDUCATION 
(Volume 29, Number 2, December 1960) 


A DEVICE FOR QUICKLY ADDING 
WEIGHTED SCORES 


JAMES W. CREASER 
University of Illinois* 


TO DETERMINE the predicted grades or other 
Scores from a regression equation of the form 


Х' = AX, + ВХ, + С 


atable or graph сап be made up to eliminate the 
repetition of many calculations. By entering such 
a chart with the variable scores, the predicted 
Score is found directly. 

For example, if in the above equation 


QU» 
"onn 
о = 


with values of X ranging from 1 to 4, a chart 
could be made up as follows: 


Xə 
1 1 2 3 4 
2 1 2 3 4 
Mi | өзге ње in. — 800% 
4 112 3 4 
X' 7 8 9 1011 12 13 14 15 16 


The broken lines indicate the path by which to 
find the predicted score for an individual with X, 
and X; scores of 3 and 2 respectively. 

In making up such a chart, there is a limita- 
tion as to the number of variables, the range of 
Scores andthe complexity of the weights. The 
limitation is not in theory but in space. A chart 
too large would lose its efficiency. 

Negative weights can be represented by putting. 
the numbers for that variable into the chart in 
reverse order. Thedistance between numbers is 
determined by the magnitude of the weights. 

For predicting student grades, the following 
formula yielded a correlation of . 69. 


X'-2.11X, + . 09X; - .14Х, + .26X, «1. 11 

However, the weights are too complex to be 
used in a simple chart. Surprisingly, the follow- 
ing simplified form yielded a correlation of . 68: 


X' = X, + X; - X, + 2X, 


A chart was constructed where each variable 
hada range of ten. This proved quite convenient. 


X; 
р i a 
"ums dee 
5. 1 3 3 
f 
і á " 
23 | 1 2 3 
ESSE ч матаи 
% Із? | | 
Ја са ilf ы еа 8 
1 : ‘eon 
x 2 3 4 5 6 7 8 9 1011 


*Chicago Undergraduate Division. 
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The chart is presented here with a range of three, 
and with broken lines to indicate the path to the 
predicted score for a student with individual scores 
of 2, 3, 1, and 3. 

It is preferrable, of course, to construct such 
а chart on paper with criss-cross lines so that the 
rows and columns may easily be followed. 

For those interested inthe mathematical theory 


of nomographic charts, two references are given. 
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TEACHER VARIABLES OF WARMTH, DEMAND 
AND UTILIZATION OF INTRINSIC MOTIVA- 
TION RELATED TO PUPILS’ SCIENCE IN- 
TERESTS: A STUDY ILLUSTRATING SEVERAL 
POTENTIALS OF VARIANCE-COVARIANCE* 


HORACE B. REED, Jr. 
Skidmore College 
Saratoga Springs, New York 


Purpose 


THE PURPOSE of this article is to illustrate 
the variety of meani ng ful questions that can be 
asked concerning the data of а single research, 
andthat can be dealt with largely through the tools 

is of variance and covariance. 
T соё esearch falls within the с ate gory of 
teacher competence studies, and is designed with 
the purpose of identifying selected teacher behav- 
іогв that relate to desirable pupil learning. 


The Variables and Rationale 


What is Competence?— The phrase “teacher 
competence" suggests the question, “Competent 
to do what?" The teacher's role as mediator of 
learning has been selected here to identify com- 
petence. This role has histori cal precedence, 
and most educational researchers now agree that 
pupil gains in learning are the most valid criter- 
ia of a teacher's competence (4,5, 9, 28). | 

The Criterion Variable.— Selection ofdesir- 
able pupil changes 25 thecriteriain ed 
petence research poses — aec 2 

jectives invo у |р 
d pepe emotional maturity, ый s 
solve complex and realistic life m EA 
creased sensitivity to the welfare of o ms = 
joyment of intellectual and artistic purs А E 
Educators frankly have no adeguate жи са, 4. 
Such objectives. Моге limited objectiv 


А , 
may or may not lead to the satima — 
purposes are being measured, but not with u m 
sal confidence. At this level of abstraction Ti | 
be found school goals such а8 pupils асер leh- 
ment on subject matter tests, attitude tests, 


terest tests, art appreciation tests, comprehen- 


*All footnotes will be found at end of article. 


sion tests, etc. А compromise with the direct 
measurement of learning has been suggested by 
Cogan (10). He has used pupils’ performance of 
required school work and of self-initiated work as 
criteria, describing these as being proximate to 
what is ordinarily referred to as pupil change. 
Cogan's intervening criteria аге an ingenious meth- 
od of avoiding the dilemma of over-particularized 
measures (such as rate of eyelid conditioning) and 
over-generalized measures (such as asking pupils 
‘From which teacher did you gain the most ?""). 

In the present research, the criterion variable 
is interest in science, as measured by the author's 
Science Interest Inventory, a 70-item scale of the 
pupil's voluntary activities in science during the 
current School year. A number of factors have 
contributed to the selection of interest in science 
as the criterion: unlike many other pupil change 
criteria, interest is relatively independent of abil- 
ity differences, especially up to mid-adolescence 
(13,33); an analysis of some of the origins of in- 
terest suggests it is amenable to influences such 
as the teacher's classroom behaviors; it is suffi- 
ciently permanent to be an important predictor of 
many future activities of pupils; and interest is a 
worthy school objective in its own right. 

Taking all these factors into account, the cri- 
terion of interest in the subject seems to meet a 
number of the common criticisms concerning the 
use of pupil change as a criterion in teacher com- 
petence studies. 

Teacher Behaviors as Antecedents.— T hat the 
behavior of teachers produces a difference in the 
atmosphere of the classroom has been a truism for 
hundreds ofyears. Clear quantitative evidence for 
this is of relatively recent origin, perhaps not 
more thanthirty years. The research on teachers’ 
classroom personalities by Anderson and Brewer 
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(3), andtheresearch on leadership and group life 
headed by Kurt Lewin (24) demonstrated clearly 
that children behave differently while under the 
training of different “фу pes” of adults. Withall 
(37) also demonstrated the existence of different 
psychological climates for differentteachers 
with the same group of children. Thelen (34), 
Callis (8), Reed (31), Amatora (2), Bush (7), and 
Cogan (10), each using different measures, dif- 
ferent samples, and different variables but all with 
careful designs, found unequivocal evidence that 
the differences among teachers can be quantita- 
tively studied, that classroom atmosphere is part- 
ly a function of the teacher's behaviors, and that 
the teacher's behaviors measurably affect the pu- 
pils. 

The teacher variables that may affect pupil 
learning can be categorized as either environ- 
mentalorpsychological. The first category would 
involve measures of the teache г' 5 home back- 
ground, number of years of schooling, the parents’ 
religious preference, etc. It is reasonable to as- 
sume that such environmental factors (past and 
present) have an effect upon teacher behaviors. 
The second category would be concerned with the 
physical, emotional, and cognitive aspects of the 
teacher. The antecedent variables of this re- 
search fall within this latter category. 

The Teacher Behavior Variable of Warmth— 
Warmth refers to pupils’ perceptions! of teacher 
behaviors which relax interpersonal tension be- 
tween teacher and pupil. There is a consequent 
reduction in the frequency of pupils’ problems 
concerning ‘‘getting along with the teacher, ” but 
not necessarily inthe frequency of problems con- 
cerning subject-matter tasks. Terms frequently 
used as synonyms of warmth are affection, affil- 
iation, consideration, kindness, friendliness, 

sympathy, responsiveness, and geniality. Teach- 
er behaviors expressive ofthe pupils’ perceptions 
of warmth are illustrated by this item from the 


antecedent scales: 


47. This teacher is careful about the 
feelings of pupils in this class 


1-Not at all. 2-A little. 
3-Somewhat.  4-Much. 
5-Very much. 


An hypothesis predicting a positive relationship 
between warmth and pupil interest in scienceis de- 
duced from the following rationale.2 The teacher’s 
warm relationship is a rewarding experience for 
the pupils, classroom learning activities become 
rewarding as a function of the teacher’s warmth 
behaviors. Pupils’ positive feelings to ward the 
learning activities lead to participation, which in 
turn, frequently leads to satisfaction ofother needs 
suchas the cognitive, as the learning activities be- 
come inherently attractive, interest is learned. 


The Teacher Behavior Variable of Demand— 
Demand refers to the standards the teacher sets 
for each pupil’s performance оп school tasks. De- 
mand is measured by items which refer to the pu- 
pil’s perceptions of the teacher’s level of demand 
as regards quantity, promptness, correctness, 
neatness, depth, thoroughness, honesty, attention, 
and orderliness. А sam ple item expressive of 
demand 15: 


15. This teacher demands that we do 
our science reading carefully 
1-Not nearly strong enough, 
2-Almost strongly enough. 
3-Just strongly enough. 
4-Somewhat too strongly. 
5-Much too strongly. 


lated to pupils’ interest in Science, with the rela- 
tionship expressed as an inverted U-shape (mod- 
erate demand being the most effective), is based 
on the following ideas. Varying levels of demand 
generate within each pupil concomitant variations 
in tensions. This tension over School work may 
often function as an extrinsic motivation. The 
tensions can become so high that the pupil is un- 
able to concentrate on the task, his energies are 
drained in many different directions in an effort 
to reduce the tensions to a bearable level. When 
tensions are very low, the pupil is not motivated 
by the challenge of utilizing his full abilities. 
When a moderate level of tension is established 
by the teacher's demands, the pupil is motivated 
to perform near the limits of his ability and/or 
willingness. In this Situation, frequent success 
results in the Schoolwork becoming enjoyable for 
its own sake. 


The Teacher Behavior Variable of Utilization 


fers to those motivations which the pupils have in- 
ternalized; the learni ng activities have become 
meaningful to the Pupils, either as means or as 
ends. The underlying task of the te acher is to 
presentthe curriculum in Such a way that the pu- 
pil appreciates the relationships between it and 
his needs, interests, attitude S, and purposes. 
The following item is expressive of the teacher's 
utilization of intrinsic motivation: 


26. When we start new work, thisteach- 
er helps us see why it is important 
to us 
1-Almost never, 
3-Sometimes. 
5-Very often. 


2-Few times 
4-ОНеп. 


An hypothesis that intrinsic motivation is pos- 
itively related to pupils’ interest in science is 
based onthe principle that ifateacher is success- 
fulinrelating the curriculum to the pupils' needs, 


participation inthe learning activities is inherent- 
ly rewarding and а continuous feedback of energy is 
directed toward further voluntary involvement. 


Design of the Research 


The Control Variables—The science teacher’s 
behaviors are not, of course, the only determinant 
of the pupils’ science interest. "The present re- 
search design employs four control variables in an 
attempt to reduce unaccounted-for variance in the 
criterion scores: sexof pupil, father's interest in 
Science, school subject, and grade level. 

Consistently, researches on science interests 
have demonstrated that boys’ interest in science 
is stronger than girls’. The present analysis in- 
cludes a study of classes (teacher-groups), and 
since the boy-girl ratio varies from classto class, 
mean class scores will reflect this variation. 
The effect of the sex variable will be tested and, 
if found significant, will be controlled through 
statistical procedures. 

It is generally assumed that the interests of 
the father will have an influence on the interests 
of the children, As a simple index of the pupil’s 
perceptions of his (her) father’s interest in sci- 
ence, this item was included in the study: 


50. How much interest does your father 
have in science? 
1-Almost none. 
3-Some.  4-Much. 

If a fairly strong relationship between f ather 's 
Science interest and pupil's science interest is 
confirmed by statistical analysis, and if classes 
differ significantly on mean father's science in- 
terest scores, differences among classes will be 
controlled through appropriate statistical proce- 
ures. 

i It is conjecturedthat the effects of teacher be- 

ili function 

iors on pupil interest may vary as a f 

е 5 and objectives of the curriculum. 
Therefore, teachers and pupils of only one sub- 


ј i 3) are used in the sample. 
E opor d that the effects of teach- 


i njecture 
er арарет vary as a function of the р 
opmental stage of the god Eee us 5 
rade (ninth) are i . 
м "hs Pupil aae E he Pupil то Ба 
composed of two parts. Part Iis the pe s 
terest Inventory, containing 70 science а ШУ 
items. Each item is scored опа eg А ^» 
fromzerotofive. Pupils were carefully EN mA. 
ed that only voluntary science activities E Е ma 
during the present schoolyear were to е те р aa 
ed. Voluntary science participation woul, ppear 
to be a more valid measure of the m 5. с 
interest than would statements 0 xu ШО 


i i tivities of the pre 
likes. Since only ac ee ee meanare af 


year were noted, the sc 3 
performance during the same months that шер 
pils were with their present science teac er. 
This temporal concomitance of measured science 


2-A little. 
5-Very much. 
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interests of pupils and measured behaviors of sci- 
ence teachers increases the tenability of reason- 
ing that a significant statistical relationship be- 
tween these two variables also implies a degree of 
causal relationship. 

Part II of the Pupil Inventory is composed of a 
random ordering of teacher behavior items; these 
provide scores for the three antecedent variables 
of warmth (13 items), demand (14 items), and uti- 
lization of intrinsic motivation (15 items). Each 
item is scored on an intensity or frequency scale 
from 1 to 5. The ascriptionof each item to а par- 
ticular variable had been agreed upon by at least 
90% of 30 scholars in the fields of education and 
psychology. 

Administration of the Pupil Inventory requires 
less than 40 minutes. 

The Sample— The sample used in the analysis 
included 1045 ninth-grade boys and girls and their 
38 general science teachers, from 19 public 
Schools representing 12 school systems in eastern 
Massachusetts. One class for each teacher was 
used, except that in three instances, two classes 
per teacher were inventoried and combined, be- 
cause of the small size of the classes. 

Administering the Pupil Inventory — The Pupil 
Inventory was administered by three trained as- 
sistants and the author. АП data was collected in 
late May and early June of 1958, to insure that 
pupils were familiar with their science teacher's 
behaviors, and to maximize the teacher's influ- 
ence on the science interests of the pupils. АП 
teachersleftthe room during the administering of 
the Pupil Inventory, with the exception of two who 
worked at their desks because the principal re- 
quested they remain, onthe basis of legal re- 
quirements. 

Each administrator read printed instructions 
aloud to the pupils, emphasizingthe privacy of the 
pupils’ answers, the importance of honest and 
careful responses, and the serious nature of the 
research. A highlevel of pupils’ concentration 
was observed. 

Scoring the Pupil Inventories—Scoring proced- 
ures revealed six cases of pupils' apparent care- 
lessnessor failure to complete the Inventory ade- 
quately. Eleven other responses were not tabulat- 
ed because the pupils had beeninthe science class 
for less than four months. 

The 120 item responses oneach of the remain- 
ing 1045 Pupil Inventories were then punched on- 
to IBM cards. To verify the copying operation 
involved in card-punching, a print-out from the 
cards was proofread against the item responses 
in the original Inventories. New cards were 
punched for any in which errors were found. 


Symbols Frequently Used in the Analysis 


У The independent variable of the pupils’ per- 
ceptions ofthe teacher's production of inter- 
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personal warmthbetweenteacher and pupil. 


M The independent variable ofthe pupils’ per- 
ceptions of the extent of the teacher's util- 
ization of intrinsic motivation. 


D The independent variable of the pupils’ per- 
ceptions of the teacher's level of demand 
for pupils’ performance on school tasks. 


с The independent variable for а compound 
measure of aspects of W and D. 4 


F The independent variable of the pupil's per- 
ceptions of his (her) father's interest in 


Science. 

I The dependent variableof the pupils! inter- 
est in science. 

r Subscript referring to a class (teacher- 
group). 

i Subscript referring to an individual score. 


t,w, Subscripts referring to total scores, to 
b within-classes scores, and to between- 
classes scores. 


A Sum of products of a dependent and an in- 
dependent variable, with appropriate sub- 
Scripts. 


B Sum of squares of a dependent variable, 
with appropriate subscripts. 


G Sum of squares of an independent variable, 
with appropriate subscripts. 


N Number of pupils in the sample. 
k Number of classes in the sample. 


Questions, Statistical Resolutions, and 
Interpretations 


What is the Reliability of the Scales for the 
Teacher Variables of W,M, and D?—For the 
scales measuring the teacher behavior variables, 
a reliability based on the stability of the within- 
classes responses of pupils is meaningful. Such 
a measure can be derived from the formula 


2 

PE ow 
<=“ + 
b 


The values in Table I are takenfromthe analysis 
of variance-covariance reported later in this ar- 
ticle. The reliabilities are between . 88 and .93 
for variables W and M, indicating that pupils of 


a given class agree fairly closely in their percep- 
tions oftheseteacherbehaviors. The reliabilities 
for D are somewhat lower (.78t0.80). A reason- 
able ex planation for the lower reliability of the 
demand scale is that, as some teachers fail to 
vary their demands to meet pupil differences, 
variations in pupilabilities affect the pupils' per- 
ceptions of the level of a teacher's demands. 

Can Single-Pupil Perceptions be Considered a 
Reliable Source Concerning Teacher Behaviors 7— 


The standard error of measurement of the scales 
can be determined by calculating the square root 
of the within-classes variance estimate. With all 
three scales, the high standard errors of meas- 
urement listed in TableIsignify that no single pu- 
pil's rating of his teacher is a reliable estimate 
of the score that the class will give that teacher. 
This does not meanthat the perception of any giv- 
еп pupil is unreliable for that pupil. А pupil who 
perceives his science teacher as highly motivat- 
ing, while most of his classmates rate the teach- 
er low, will be affected by the teacher as he sees 
theteacher. The classroom Science teacher can 
expect pupils to agree in general as to how they 
see him; he can also expect some divergence of 
individual pupil impressions. The concept of «га 
class" can lead to erroneous conclusions if the 
teacher supposes that his behaviors are uniform- 
ly perceived. 

Are There Significant Differences Among the 
Teachers for the Antecedent Variables?— Table I 
Shows the variance estimates for testing the sta- 
tistical hypothesis of no difference among class 
means for each of the major variables of W, M, 
and D (data isalso included for the criterion var- 
iable I. Acceptance ofthe hypothesis of no dif- 
ference for any variable would render meaningless 
а between-classes analysis involving the variable. 
Since all F's are significant at ће . 001 level, this 
hypothesis is rejected. Each of the scales, then, 
did measure differences among teachers. 

Do Boys andGirls Perceive Teachers Similar- 
ly as Regards the Teacher Variables of W, M, and 
D?—The fairly close agreement between the boy 
and girl means for W, M, and D shown in Table 
П suggests that the two sexes tend to rate their 
teachers ina similar fashion. Tests of the dif- 
ference between boys’ and girls’ means for each 
of the three variables provided no Significant CR’s 
at the . 01 level. 

What is the Reliability of the Science Interest 
Inventory ?—A reliability based on the stability of 
of the within-classes responses of pupils is not 
applicable to the criterion scale meas uring the 
individual pupil's interest in Science; instead, an 
internal reliability concerned with the consistency 
of the items in the science activity scale is need- 
ed. Using a split-half reliability technique, the 
10 items of the Science Interest Inventory were 
logically divided into two equivalent half-tests- 
The responses of the 1045 pupils were used for 
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TABLE I 


VARIANCE ESTIMATES FOR I, W, M, AND D SCORES—BOYS (N - 584) AND GIRLS (N - 452)* 


Sum of Variance Standard Variance 
Source Squares df Estimate тхх Еггог Ratio** 
Between 269,86 37 1293.94 
Boys Within 1,825,848 546 3344.04 2.18 
1 
Between 196,603 33 5957.67 
Girls Within 979,399 418 2343.06 2.54 
ee 2 7E EET o ToO xc 
Between 271, 863 3" 153. 05 
Boys Within 48,959 546 89.67 :99 905 8. 40 
w 
; Between 41,408 38 1254.19 
Gils Within 37,034 418 88.60 “92 94 1416 
Between 24, 703 37 667. 65 
Boys Within 43,853 546 2840 849 8.51 
M 
i Between 25, 188 33 763. 27 
Girls Within 34,865 418 ия 9. 15 
Between 13, 806 37 373. 14 
Boys Within 45,005 546 3.4: TO В 4. 53 
р 
Between 14,958 33 453.27 
Girls within 38,651 418 xar ED Ue 4. 90 


* Thi irl sample is 9 less than the original N, as a result of the elimination of 4 
w је oe than 5 girls per class. The total number of girl classes is 34, while 
the boy classes remain at 38. 

**AII F's are significant at . 001 level. 
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TABLE П 


COMPARISON OF THE TOTAL BOY AND THE 
TOTAL GIRL MEANS FOR W, M, ANDD 


Variable Mean N S. D. CR* 
W Ges 450 42 а >" 
2 EE Rp w 
P Gins т 40 шз 20 


*No CR's are significant at the . 01 level. 


correlating the split-halves scores, and when the 
correction is made with the Spear man- Brown 
formula, a reliability coefficient of . 97 is ob- 
tained for the whole criterion scale. This high 
value indicates internal consistency of the science 
jnterest items, and consistency of each pupil's 
responses. 

Do Boys and Girls Have Equally Strong Sci- 
ence Interests ?—In the original treatment of the 
data, this test was the first order of business, 
since a significant difference in boy and girl I 
scores would necessitate control of the sex vari- 
able. The I score of the 584 boys is 130. 3; the I 
score for the 461 girls is 103. 8. From Table III 
a variance ratio of 57. 0 is obtained, and the sta- 
tistical hypothesis of no difference is rejected at 


the . 001 level. 


TABLE Ш 


TESTING SEX 
ARIANCE ESTIMATES FOR 
қ DIFFERENCE ІМ MEAN I SCORES 


| f Variance Var. 
Source eed df Estimate Ratio* 

7 
Between 181, 637 1 181,63 мы 
Within 3,322,353 1043 3, 185 


*Significant at the . 001 level. 


ifference between the two mean scores 
is E aem that pooling of girl and boy Scores 
would lead to major distortion in the analysis in- 
volving classes. Therefore, the total sample is 
separated intotwo sub-samples, one for the boys 
and oneforthegirls. At this point the total num- 
ber of girls is reduced from 461 to 452, after 


elimination of four classes with fewer than five 
girls per class. The number of boy classes is 38; 
the number of girl classes is 34. 

Is There a Significant Relationship Between 
Father's Interest in Science and Pupil's Interest 


in Science ?—Table IV contains data on the product- 


moment correlation coefficient for Е and I. The 


obtained гут for boys (.40) and грт for girls (. 27) 
are based on total samples. Application of the 
significance test indicates both r's to be signifi- 
cant at the . 001 level. 


TABLE IV 


RELATIONSHIP OF F ANDI 


Variance 
Sample грр  Ratio* df 
= n= 1 
Total, Boys (N=584) -40 108.4 n, = 582 
Total, Girls (N-452) 297 344 m : ЖЫП 


*Both ratios are significant at . 001 level. 


In Studying Teacher Effects, Does the Influence 
of Е Upon I Need to be Controlled?— The obtained 
significant relationships of гүү pose the problem 
of whether there is sufficient attenuation of I scores 
for classes, attributable to differences among F 
Scores for classes, to weigh in the choiceof meth- 
ods of analysis. Table V presents the requisite 
variance estimates for the test of significant dif- 
ferences among the boys’ Е scores for classes, 
and also among the girls' F scores for classes. 
The obtained variance ratios for boys of 1. 56, and 
Íor girls of 1. 62, are not significant at the . 01 
level, but are at the . 05. The statistical hypoth- 
esis of no differences among F scores for classes 
is accepted, with some reservations. 


TABLE V 


VARIANCE ESTIMATES FOR TESTING DIF- 
FERENCES AMONG F SCORES FOR CLASSES 


Sum of Variance Var. 

Source Squares df Estimate Ratio* 

Between, Boys 78.0 37 2.10 1.56 
Within, Boys 736.9 546 1.35 у 

Between, Girls 64.7 33 1.96 1. 62 


Within, Girls 506.5 418 1.21 


*Neither ratio is significant at the . 01 level, but 
both are significant at . 05. 
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McNemar (27:354), in discussing procedures 
for adjusting scores by the covariance method, 


writes: 


.... But, if the within-group correlation is 
low and/orthere is only a small chance 
difference between the groups on the uncon- 
trolled variable, the use of the covariance 
adjustment may not be worth the effort. ... 


The moderate strengthof the relationship of F 
and I, and the lack of significant differences at 
the . 01 level among Е scores for classes, dem- 
onstrates that a very limited amount of the vari- 
ability of I scores for classes can be reduced by 
correcting for differences due to F. Therefore, 
the attenuation of I scores for classes, due to the 
influence of F, was considered insufficient to dic - 
tate subsequent methods of analysis. 


Does the Father’s Science Interest Have а 
on’s Interest Than on 


Does the Father's Science Intere оп 
Greater Influence onS 
Daughter's 7—А test of any significant difference 
in the гру for the boy sample (. 40) and the girl 
sample (. 27) can be made using Fisher ao о z 
transformation. The resulting critical ratio о 
2.33 is significant at the . 02 level. The statisti- 
cal hypothesis of no significant difference {д Де 
jected atthe.02 level. The demonstration ар = 
difference supports the ге asoning ydus ГЕ 
ninth-grade level, sons tend to imitate t = 
thers somewhat more closely than do daug ее. 

Is There а Significant Relationship patus т 
and I, and is it Non-Linear —Values for 


ат for the H ratio are 
e i the correlation 
ar correlation and for e estimates for 


in Table VI. Therelevant varianc 


TABLE VI 


RELATIONSHIP OF D ANDI 


ationship* 


ength of Rel 
Strengt 15 (N-461)* 


Type of 

Relationship Boys (N-584) G 
.04 

Linear (г) .04 
Correlation .19 
Ratio (eta) .13 - T 
* None of the relationships 18 sips 

.01 fthe 
**This analysis, based on the a ER «ОГ major 

total samples, was m4 а computer 


analysis involving raw score’ ction of the 
techniques. At this stage, the T nade- 
girls’ N to 452 had not yet bee 


„nificance of 
determining eta, and the tests for аш wn in 
eta and of linearity of regressio” ‘estimates for 
Table уп. The ratio of VAT janer nm pro- 
between-array means and for within 


vides a test for the significance of eta. The ob- 
tained F's of . 81 for the boy sample and 1. 43 for 
the girl sample indicate large within-arrays var- 
iance. For both the boy and the girl samples, the 
linear relationship and the correlation ratio are 
not significant at the .01 level. A further test for 
em of curvilinearity would be meaning- 
ess. 

While the predicted positive effect of mild ten- 
sion was not demonstrated, it is important to em- 
phasize that this researchdidnot demonstrate the 
negative relationship between tension and pupil 
gain traditionally hypothesized. This consistent 
lack of a relationship betweenteacher demand and 
the broad school objective of pupils’ interest in 
science may encourage other researchers to in- 
vestigate the relationship of teacher demandto 
more specific criteria, such as subject matter 
achievement., There is the evidence from this re- 
search that the more general goal of interest will 
not necessarily be adversely affectedas a concom- 
itant of the teacher’s use of demand. 

What is the Relationship Between M and 1?—In 
this study, the strongest relationship between any 
teacher behavior variable andthe criterion is be- 
tween M and I. The most accurate measure of the 
relationship based on individual pupil scores is 
provided by the within-classes ry, which cor- 
rects for possible spuriousness evidenced by be- 
tween-classes corre lation. Tables VIII and IX 
show the within-classes rygvalues: . 32 for boys 
and .42 for girls, both significant at the . 001 lev- 
el. Also from Tables VIII and IX, the between- 
classes гмт for boys (.40) is significant at the . 05 
level; the between classes ryg for girls (. 53) is 
significant at the . 01 level. 

There is no significant difference at the . 01 
level between these correlations of Mand I for the 
boy sample and the comparable correlations of M 
and I for the girl sample. 

For the form of the relationship, a test of the 
hypothesis of linear regression for the total гүү 
can be made through the formula 


sa k = number of arrays 
F == n-k-2 
Sw n =N-k 


where Sq? represents the variance estimate based 
on the deviation of array means from the line and 
Sw represents the variance estimate based onthe 
deviationof individual scores within arrays. Val- 
ues for the F ratios of the two samples are in Ta- 
ble X. Sinceboth F’s are less than unity, the hy- 
pothesis of linear regression is accepted for each 
sample. 

Two of the variance estimatesof Tables XI and 
XII may be used to provide an F ratio to test for 
linearity of regression based on the means of M 
and I (between-classes гу): 


TABLE УП 


VARIANCE ESTIMATES FOR STUDYING THE FORM OF гру 


Boys (М = 584) 


Girls (М = 461) 


Sum of Variance Sum of Variance 
Source Squares df Estimate Squares df Estimate 
Linear Regression 7. 85 1 7. 85 5. 30 1 5. 30 
Deviation of Means 
from Line 66. 31 11 6.03 110.14 11 10.01 
Between-Array 
Means 12. 60 12 6. 05 114. 86 12 9. 57 
Within Arrays 4290. 10 571 1.51 3005. 34 448 6. 71 
Residual from 
4354. 85 582 1.48 3114. 90 459 6.19 


Line 
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TABLE УШ 


ANALYSIS OF VARIANCE:COVARIANCE, FOR FUNCTIONS OF M AND I—BOYS 


Total Within Between 

Sum of Products 

M and I Ај = 123, 118 Aw = 90, 263 Ађ = 32, 855 
Sum of Squares, I Bt = 2, 095, 724 Ву = 1,825, 848 Bp = 269, 876 
Sum of Squares, M Ct = 67,556 Су = 42,853 Ch = 24, 703 
df for Variances N - 1 = 583 N - k = 546 k-1=37 
Correlation Coef- At __ 2.33 Bw -,92 _ Ab 1. 

ficient, TMI УВЕ УСІ УВу VCw VBb VCb | 
df for rMI N - 2 = 582 М-К-1=545 к - 2 = 36 


Significance Level 
for rMI 


Regression Coef- 
ficient, bzw 


ANALYSI 


Sum of Products 
M and I 


Sum of Squares, I 
Sum of Squares, M 
df for Variances 


Correlation Coef- 
ficient, гут 


df for гу 


Significance Level 
for гү 


Regression Coef- 
ficient, Ым 


s OF VARIANCE:COVARI 


Sig. at . 001 level 


TABLE Ix 
ANCE, FOR FUNCTIONS OF M AND I—GIRLS 


Total 


At = 114,954 
By = 1,176, 002 
Ct = 60, 053 
№-1= 451 


А 2,49 


УВЕ ТС 


y - 2 = 450 


Sig. at ‚001 1еуе1 


At 1.91 
Ct 


Sig. at . 001 level 


Aw 
ex = 2.11 


Sig. at . 05 level 


Ab 


Б^ 1.33 


Within Between 
Aw = 77, 131 Ap = 31,223 
By = 979, 399 Bp - 196, 603 
Cw = 34, 865 Cp = 25,188 
N-k-418 k-1-33 
B _ 2.42 0b 24.53 
VBw УС Y Bp Y Cb 
N-k-1=417 k - 2 = 32 


Sig. at . 001 level 


Aw . 2.23 
Cw 


Sig. at . 01 level 


Ab 
m" 1.48 


TABLE X 


VARIANCE ESTIMATES FOR STUDYING THE FORM OF гу 


Boys (N - 584) 


Girls (N - 452) 


Sum of Variance Sum of Variance 
Source Squares df Estimates Squares df Estimates 
Linear Regression 419. 26 1 419. 26 433. 06 1 433. 06 
Deviation of Means 
from Lime 60. 64 12 5.05 33. 39 12 2. 78 
Веімееп- Аттау 
Means 460. 45 13 35. 42 472.30 13 36. 33 
Within Arrays 3902. 25 570 6. 85 1982. 30 438 4.53 
3943. 44 582 6. 78 2021. 94 450 4, 49 


Residual fram Line 


PIZ 
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TABLE XI 


VARIANCE ESTIMATES FOR TESTS OF SLOPES бр BOYS 


Source of Variance 
Variance Formula and Variance а Estimate 
Class r's About Common КА Aye 
Coefficient Doe = SY = — 01,881 k-1 = 37 512 = 1672.5 
1 Cir Cw 
Individual Scores About 
Regression Line of ТЕ 
Each Class By - > = 1,573, 842 N-2k = 508 522 = 3098.1 
1 Cir 
Group Means About Re- 
gression Line based on Ay? 
Means Bp - ^b = 226,179 k-2 = 36 S,? = 6282.8 
Ср 
Individual Scores About 
Regression Line of Com- Aw? 
mon Within Slope By- № = 1, 635, 723 N-k-1 =545 Sw^ = 3001.3 
Cw 
Group Means About Re- 
gression Line of Com- An? де 
mon Within Slope Bp + 2% -At = 235, 624 k-1 = 37 Sp? = 6368. 2 
Cw Ct 
Individual Scores About 
Regression Line for 4% 
Total Group - + - 1,871, 347 N-2 =582 
Ct 


qud 


SIC 
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VARIANCE ESTIMATES FOR TESTS OF SLOPES byr4—GIRLS 


Source of Variance 
Variance Formula and Variance df Estimate 
Class r's About Common 
Coefficient х Air? = Ay = 39,801 Бер = 88 Sı? = 1206.1 
1Cir Cw 
Individual Scores About 
Regression Line of ы 
Each Class Bw- 225^ _ 166,298 N-2k = 384 S," = 1995.6 
1 Cir 
Group Means About Re- 
ression Line Based 
= Ке _ Ap? = 141, 595 k-2 = 32 S,? = 4424.8 
Cb 
Individual Scores About 
Regression Line of Com- 2 2 
mon Within Slope By - Аж“ = 806, 099 N-k-1 = 417 Sw? = 1933.1 
Су 
Group Means About Re- 
gression Line of Com- 2 AR 2 _ 
mon Within Slope Bp + a - Gr - 149,857 k-1 = 33 Sb = 4541.1 
Individual Scores About 
Regression Line for 2 
Total Group B - oe = 955, 956 N-2 =450 
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Е- 854 n = k-2 
Sw nj = N-k-1 

The obtained variance ratios of 2.09 for boys and 
2.29 for girls are significant at the . 001 level. 
This demonstrates that the estimate of the vari- 
ance of class means about the regr ession line 
based on means (6.2) is significantly larger than 
the estimate of the variance of individual scores 
about the regression line of common within- 
classes slope (Sw). Therefore, the hypothesis 
of linearity of regression based on means is re- 
jected for both the boy and the girl sample. 


Are the 38 Separate Class Slopes b for Boys 
Separate Class Slopes 


Equivalent, and are the 34 5 
Tor Girls Equivalent ?—Tables XI and XII provide 
the necessary variance estimates to test the hy- 


pothesis that slope ЫМ of the within-classes re- 
gression line is equivalent for all classes ofa 


given sex sample. The formula 


= Si n; = ket 
е; n = N-2k 
m i .54, for the boy sample. А 
esults inan F of 54, rs шаг 


Similar test for the girl 
that is also less than unity. 1 
variance of class r's about th I 
cient (S,?) is less than the ет 
ance of the individual scores abou mde тт 


line of each class (5,2). The hypoth ^ 
mon within-classes slope for all boy classes an 


à common within-classes slope for all girl class- 


i his common within- 
es, is accepted. For boys, t val common within- 


classes рүм is 2-11; for girls, ond IX) 


The estimate of the 


Pupils’ interest in 5С 

а above demonstration lm = 
ys and for girls) the highly . That 

Classes етігін common for all classes 


із, any variations ато в oe m 34 separate 
Slopes bry for boys, and pss be attributed to 


Class slopes ЫМ for 81115, 


Sampling error. 

Figure 1 illustr 
regressions for the to 
Within-classes slope, 206 
Class means, The variatio 
class slopes from the comm "т at 
Slope are shown. Also indicates | ‘оп line deter- 
the class means about the regress 
mined by those means. The girl S9 дев one more 
ed for illustration because it prO ге 

ghly significant regression per : 

$5) than was de monstrated eal lass means is 
For simplicity, the slope for the | 3 i 
Shown here as a linear гебт ов S regressi 
has been established thatthe act" 
curvilinear 


ates for the girl sample the 


tal slope ТЕ ре of the 


rth 
т ud of the 34 separate 


REED dm 


The threeregressionequations, and values for 
the appropriate slopes, are summarized in Table 
XII. The equation for the 34 separate class slopes 
is given; the separate values are too detailed to 
list. 

Are There Factors, in Addition to M and Other 
Controlled Variables, Which are Affecting the Cri- 
terion Scores 7— To resolve this question it is nec- 
essary to test the hypothesisthat a single regres- 
sion line fits both total and between-classes pop- 
ulations. To test this hypothesis, the following 
variance ratio is appropriate: 


"EN n-k-1 
ce n = N-k-1 


The relevant variance estimates for the two 
samples are presented in Tables XI and XII. The 
Е ratios for boys (2.12) and for girls (2. 10) are 
both significant at the . 001 level. Therefore, the 
estimate of the variance ofgroup means about the 
regression line of the common within-classes 
slope (Sp?) is significantly larger than the esti- 
mate of the variance of individual scores about the 
regression line of common within-classes slope 
(S^). The hypothesis of a common r egre ssion 
line for all populations is rejected for both sam- 
ples, since acceptance would require that Si? and 
Sy? be similar. 

The lack of a common slope means that with 
respect to classes there are factors other than 
teachers' utilization of intrinsic motivation which 
account for some ofthe variationin interest scores 
among the classes. Certain of these attenuating 
factors had been anticipated priortothe collection 
of the data, and various methods of control were 
included inthe design to eliminate or reduce their 
possible effects (sex of pupil, father's science in- 
terest, subject matter, and grade level) Many 
other possible forces were beyond the scope of 
this study, such as additional characteristics of 
the teachers, school atmosphere, and previous 
experience of the pupils. 

What is the Relationship Between W and 126— 
The product moment correlation coefficients for 
W and I are calculated from the information in 
Tables XIV and XV. The within-classes гут val- 
ues are . 20 for boys, and . 28 for girls, both sig- 
nificant at the . 001 level. 

The between-classes rwy for boys of .23 is not 
significant at the .01 level. The higher between- 
classes rwy for girls of . 53 is significant at the 
. 01 level. 

A test of the difference between the boy and the 
girl within- classes rwr, using Fisher’s г to z 
transformation, results ina CR of 1.35. This 
ratio is not significant at the . 01 level. The hy- 
pothesis that the two r's are not significantly dif- 
ferent is accepted. A test of the difference be- 
tween the boy and the girl between-classes гут 
results in a CR of 1. 44, which is not significant 
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FIGURE 1 


RELATIONSHIP BETWEEN M AND I (GIRLS) 
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TABLE XIII 


REGRESSION EQUAT. 


IONS FOR M AND I—GIRLS 
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Source of Regression Equation Slope 
Total Kt = Т + bei - M) Ww = 1:01 
Common Within-Classes lir' = Ip + bw(Mir - Mr) by = 2.23 
Between Classes т' = Т + bp(Mr - М) bp - 1.48 
цг' = 1 + br(Mir - Mr) br = (34 separate 
values) 


Any Specific Class 


ANALYSIS О 


Sum of Products, 
W and I 


Sum of Squares, 1 
Sum of Squares, W 
df for Variances 


Correlation Coef- 
ficient, rwI 


df for гүү 


Significance Level 
for гул 


Е VARIANCE:COVA 


TABLE XIV 


RIANCE, FOR FUNCTIONS OF W AND I- BOYS 


Total Within Between 
At = 80, 727 Aw = 60, 703 Ађ = 20,024 
ві = 2, 095, 124 By = 1, 825, 848 Bp = 269, 876 
сү = 16,822 Су = 48,959 Cp = 27, 863 
N-1-583 N-k-546 k-1237 

A A 

А -- \—-.20 Бы ер 
TA Би Cw Tip vee 7025 
y- 2 = 582 N-k-1- 545 ке 2= 96 
gig. at ‚001 level Sig. at . 001 level Not sig. at .01 level 


TABLE XV 


ANALYSIS OF VARIANCE:COVARIANCE, FOR FUNC TIONS OF W AND I—GIRLS 


Total Within Between 
Sum of Products, 

W and I At = 101, 399 Aw = 53, 622 Ab = 47,777 
Sum of Squares, I Bt = 1, 176, 002 Ву = 979, 399 Bp = 196, 603 
Sum of Squares, W Ct = 78, 442 Су = 37, 034 Cp = 41, 408 
df for Variances N - 1 = 451 N - k = 418 k- 1 =:38 
Correlation Coef- ~ Esa Ан = 28 Ab 5,58 

ficient, гут УВЕ УбЕ УВу V Cw Bp VCb 

N - 2 = 450 N-k-1= 417 k- 2 = 32 


df for гут 


Significance Level 
for гүут 


Sig. at .001 level 


Sig. at .001 level 


Sig. at . 01 level 


TABLE XVI 


DATA FOR MULTIPLE R 


Boys Girls 

Zero Order Product of Zero Order Product of 

Betas r's Bandr Betas r's Bandr 
У:В2 -. 147 түт = .20 -. 029 У:Во = -. 024 түт = .33 -. 008 
M:B3 335 TMI = .33 . 111 M:B3 = .396 rMI = .43 . 170 
D:B4 -. 091 грр = .03 -. 003 D:B4 = -.096 TDI = .03 -. 003 
С :В5 107 ІСІ = .25 . 027 C:B5 = .083 ІСІ = .34 . 028 
F :B6 362 тр = .40 . 145 F:Bg =  .219 rp] = .27 . 059 
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at the .01 level. 
Can Prediction of I be Increased Through а 


variance estimate as the denominator term. As 
indicated by previous correlation analysis of M 


Study of the Relative Contributions of W, M, D, 
and Е?-Тһе relative contribution of each of the 
antecedent variables tothe prediction of the inde- 
pendent variable I can be observed in Table XVI 


(products of B's and r's). For both the boy and 
the girl samples, the two variables of M and F 
e more pre- 


contribute the most weight, with F th 
dictive for boys and M the more for girls. 

The value of R (multiple correlation) is 250 
for the boy and for the girl sample. The obtained 
F for boys is 37.9, and for girls is 29.2; both R's 
are significant at the . 001 level. | | 

While the many origins of pupils' interest in 
Science do not constitute the central problem of 
this study, it is worth noting that 25% of the var- 
lance in pupils’ science interest scores can be ac- 
counted for by a knowledge of the variation in 
Scores for the teacher’s utilization of intrinsic 
motivation and for the father’s interest in sci- 
ence, 

Does the Effect of One Teacher Variable Upon 
I vary as a Function of Other COR eelle pave 
ables ?—In Tables ХУП and ХУШ, four cells haye 
been formed by a double classification based о 


2 ivation 
class m es for high and low той 5 
ean scor h dnd (there were no 


and for moderate and low d 
high D scores for classes). The сеп нан dum 
derived from the corresponding la воо 
classes, The variations of these cell pues d 
gests that the differences in la scores = also to 
Only to the effects of high and low М, о con 
Some other influence. sD nee ү a of the 
correlation with I, it is possible tha я the inter- 
differences inthe cell means are due 
action of M and D. А jon of М and 
A test of the hypothesis of interaction ance. 
Э is made through complex апу | 
rior to this analysis, two steps jability of 
to account H or e much within-cell variability 
Scores for classes 25 Poss? to F sc 
Was adjusted for differences due nation for ad- 
classes, 6 using the regression equ 
Justed scores: 
"Uu" - F) 
Ira = Ir = Ыруг а 
jally gauge 
The reduction in variability canbe par insted ens 
by comparingthe unadjuste with ed in Tables 
ОЁ squares for I, as Sum „= 
апа хх. 
In the second prior Step» i 
Proportio Daly of cell ле c 
ough procedures outlined у term 15 


ann (36). The adjust d is subtract- 
the sum and D, ап 3 
of squares for я action. 
for inter ion dat 


ed from the es 

sum of squar 1 t 
Table XXI summarizes the ape e 
oe Variance ratios to test the using 
O test interaction are formed b 


and Iscores for classes, the main effect of mo- 
tivation is significant for girls at the . 01 level 

and for boys at the . 05 level. In both samples, 
the non-significant variance ratio for the main еї- 
fect of demand is also to be expected from рге- 
vious analysis. Since neither variance ratio for 
interaction is significant at the . 01 level, the hy- 
pothesis of no interaction of M scores for classes 
with D scores for classes is accepted for both 
samples. If the interaction effect does exist, it 
is not sufficiently strong to be demonstrated with 
the number of classes available for study. 

Is There an Interaction Effect of M and D, Us- 
ing Pupil I Scores as Criterion?—Increased cell 
frequencies may be obtained by using pupil scores 
as a basis for further study of interaction of M 
with D, using cells formed essentially as in Ta- 
bles XVII and ХУШ. Individual I scores аге not 
adjusted for differences due to the influence of F, 
since control by covariance adjustment is appro- 
priate only with groups. Adjustment is made for 
disproportionality of cell frequencies. The var- 
jance estimates for this test of interaction are 
presented in Table XXII. For both samples, the 
variance ratio is significant at the . 001 level for 
the maineffect of M. The main effect of D is not 
significant at the .01 level for either sample. 
The variance ratio for intera ction is less than 
unity in both samples, demonstrating large with- 
in-cell variance. The hypothesis of no interac- 
tion is accepted. 

A similar series of tests for interaction of W 
and D, using pupil I scores as the criterion, re- 
sulted in acceptance of the hypothesis of no inter- 
action for this combination of variables. 

Does Sex of Teacher, Interacting with Sex of 
Pupil, have an Effect on Pupils’ I Scores?—As the 
sample includes both womenteachers (N - 10) and 
men teachers (N - 28), it is poss ible to test for 
differences in pupil I scores attributable to teach- 
er sex. (The test of significance for the main ef- 
fect of pupil sex has been discussed previously.) 
Table XXIII shows the variance estimates for test- 
ing interaction andthe main effect of teacher sex. 
The hy pothesis of no difference due to teacher 
sexisaccepted, since the obtained variance ratio 
is less than unity. The hy pothesis of no differ- 
ence due to interaction is accepted, since the ob- 
tained Е of 2.07 is not significant at the . 01 level. 

Does Sex of Teacher, Interacting with Sex of 
Pupil, have an Effect on Pupil Perceptions of 
Teacher Behaviors?— Tests for any differences in 
pupil perceptions of men and women teachers for 
D, M, and W can be made using the values in Ta- 
ble XXIV. (The lack of significant differences in 
perceptions of D, M, and W due to pupil sex has 
been previously discussed.) The obtained vari- 
ance ratios for the main effects of teacher sex 
and for interaction, are not significant at the . 01 
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TABLE XVII 


Motivation 
| ma — | un 
= 
ме 1 2 
о = 
d 1 = 145.2 I, = 122.3 
e 
г 11 cases 8 cases 
D a 
e t 
m e 
a 3 4 
n 
d = = 
L I, = 130.7 4 =127.4 
о 
У 8 cases 11 cases 
*The T scor 


r classes have been adjusted for class dif- 


es fo 
ferences due to F 


TABLE XVIII 


M 
5 2 
а па Т. 
8 I; 111.9 I = gg 7 
D 2 10 cases "I cases 
e t 
m e 
a [Г Дт = 
п 3 4 
d 
L Т, = 1144 B = 
^ а = 104.8 
w " cases 10 cases 
| |. 
*The I scores for classes have been a 
to F. 


ferences due 


djusteq for Class dig. 


ANALYSIS OF VARIANCE 


REED 


TABLE XIX 


.COVARIANCE, FOR FUNCTIONS OF Е AND I- BOYS 


of Squares 


Total Within Between 
Sum of Products, 

Е and I At = 16, 357 Aw = 13, 842 Ap - 2,515 
Sum of Squares, I Bt = 2,095, 724 By = 1, 825, 848 Bp - 269, 876 
Sum of Squares, F Ct = 815 Cw = 737 Cp = 78 
df for Variances N-1-583 N - k = 546 К -1= 97 
с 1 Coef. At Aw T Ap 

orrelation Coei- 2.40 =. ——— gs ВБ 

ficient, rpy J Bt VCt УВу У Cw Y Bp УСЬ 
А А 
Regression Coef- Ж 280.1 АЯ = 18.8 Ab _ 39.9 
ficient, бре Ct Cw Cb 
$ 2 Aw" 
ENS Sum of Bt- ж minus - e. equals Adjusted Bp 
oed T Ct 1, 767, 360 1,565, 839 201, 521 
df for Adjusted Sum 2 = 582 N-k-1-545 k-1237 
of Squares [әле 
ТАВЉЕ ХХ 
(COVARIANCE, FOR FUNCTIONS OF F AND I-GIRLS 
ANALYSIS OF VARIANCE:C 
Total Within Between 
Sum of Products, ABS 6,904 Ay = 5, 112 Ap = 1,192 
P p, = 1, 176, 002 By = 979, 399 Bp = 196, 603 
1 21,119, 
Sum of Squares, Cy = 506 сь=65 
ж сү = 571 w 
Sum of Squares, gute ist N - k = 418 k-1=33 
df for Variances 
At AW =.26 Bb 70 
Correlation Coef- Tia 2.27 JBwYCw ` УВЬ Y Cb 
ficient, гр 
Aw 11.3 Pb 2184 

Regression Coef- At _ 12.1 te Gp = 

ficient, br Ct Ay? | 

Adjusted Sum of _ At minus Ву - бу equals Adjusted Bp 

Squares, I Cty 092, 554 914,983 177,571 
| -к-1=417 k-1-3 
df for Adjusted Sum y- 2-450 N 3 
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TABLE XXI 


VARIANCE ESTIMATES FOR TEST OF INTERACTION OF M WITH D 
BOYS (N - 38) AND GIRLS (N = 34) 


SCORES FOR CLASSES— 


Adjusted Sum 


Level of 
Significance 


Variance Variance 
Source of Squares* df Estimate Ratio 
Motivation 1882.0 1 1882.0 6.15 
= Demand 492.1 1 492.1 1.61 
2 Interaction 604. 4 1 604. 4 1.98 
Within 10401. 0 34 305. 9 


Sig. at . 05 level 
Not sig. at . 01 level 


Not sig. at . 01 level 


Motivation 2950.1 


1 2950.1 


9. 50 
G 
i Demand 1163. 6 1 1163. 6 3. 75 
r 
1 Interaction 104.5 1 104.5 2.27 
5 

Within 9315.5 30 310.5 


Sig. аё. 01 level 
Not sig. ай. 01 level 


Not sig. ај. 01 level 


*Sum of Squares adjusted for disproportionality of cells, 


VARIANCE ESTIMATES FOR TEST OF INTERACTION OF 
BOYS (N = 584) AND G 


Adjusted Sum 


M WITH D scorEs— 
IRLS (N = 452) = 


Variance i 
Source of Squares* df Estimate = 
Motivation 148, 054 1 148, 054 44.14 
Д Я 
б Demand 11,165 1 11,165 3. 33 
y А 
4 Interaction 2,110 1 2,110 . 63 
Within 1,945,123 580 3,354 
tivati 1 
Р Motivation 23,814 1 123,814 53.18 
i Demand 222 1 222 
l ; .10 
1 Interaction 868 1 868 
: „87 
Within 1,043, 112 448 2, 328 


*Sum of squares adjusted for disproportionality of cells, 


Level of 
Significance 
Sig. at .001 level 


Not sig. at . 01 level 


Not sig. at . 01 level 


Sig. at . 001 level 


Not sig. at . 01 level 


Not sig. at. 01 level 


TABLE XXII 


VARIANCE ESTIMATES FOR TESTING EFFECTS OF TEACHER SEX ON BOY 


AND GIRL I SCORES (N - 1036) 


le Adjusted Sum Variance Variance Level of 
Source of Squares* dt Estimate Ratio Significance 
Teacher Sex 1,303 1 1,303 . 41 Not sig. at .01 level 
Pupil Sex 182,902 1 182,902 58. 83 Sig. at . 001 level 
Interaction 6,546 1 6,546 2.01 Not sig. at . 01 level 
Within 3,263, 875 1032 3,163 
*Sum of squares adjusted for disproportionality of cells. 
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TABLE XXIV 


IONS OF D, 


STING EFFECT: 


S OF TEACHER SEX 
M, AND W (N - 1036) 


ON BOY AND 


Adjusted Sum Variance Variance Level of 
Source of Squares* df Estimate Ratio Significance 
Teacher Sex 314 1 314 2. 89 Not sig. at . 01 level 
Pupil Sex 488 1 488 4. 49 Not sig. at . 01 level 
> Interaction 3 1 3 . 03 Not sig. at . 01 level 
Within 112,103 1032 109 
Teacher Sex 297 1 297 2.41 Not sig. at . 01 level 
Pupil Sex 112 1 112 .91 Not sig. ај. 01 level 
К Interaction 204 1 204 1. 66 Not sig. аб. 01 level 
Within 127, 108 1032 123 
Теасћег бех 5,959 1 5959 41. 30 Sig. at . 001 level 
w Pupil Sex 41 1 41 228 Not sig. аё. 01 level 
Interaction 409 1 409 2. 84 Not sig. ај. 01 level 
Within 148, 896 1032 144 


с LASSIFIC ATION ОЕ 
SEX АМ 


TABLE xxy 


W SCO; 
D PUPIL SE 


RES, BASED ON 


X (N = 1036) 


TEACHER 


Teacher Sex 


» 


Wm cm шее ee 
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level with one important exception: the main ef- 
fect of teacher sex with W as the criterion. The 
obtained variance ratio of 41. 30 for differences 
in pupils’ perceptions of W attributable to teach- 
er sex is significant atthe .0011еуе!. Table XXV 
demonstrates that both boys and girls tend to rate 
the women teachers considerably lower than men 
teachers on W. 

One explanation forthis findin| 
are less accustomed to с lose, 
with men, and feel that men are less approach- 
able. Objectively similar warmth behaviors of 
men and of women teachers may be so perceived 
that pupils over-estimate the strength of the У 
behaviors of the menteachers. Or perhaps in this 
sample the men teachers had, in general, warm- 
er personalities than did the women. | 

What Implications сап be Drawn from the High 
Intercorrelation of Wand M ?—1n the construction 
of the scales measuring the teacher behavior var- 
lables of W and M, an attempt was made to dis- 
tinguish clearly between them. As previously 
discussed, competent judges did distinguish be- 
tween the two variables. Yet the inter correla- 
tion of W and M (. 66 for boys and . 70 for girls) 
and the results of partial and multiple corre 
analysis, indicate that W scores have little eh 
dictive power that is not 2180 available throug 
Scores for M, but not vic It could be ВЕ. 
gested that pupils did not distinguish between 
апа W, due either to inadequate 5 
tion or to pupils’ subjec 


gis that children 
frequent rapport 


the fact that 


perceptions of teachers. However, в 
і я ү oth boys and girls 
n responding to the W items, both "ly lower on 


rated as : 
women teachers t did not 60 differentiae 
ils did dis- 
as regards Mitems, i i 
ұшынан between warmth and 2 
ehaviors. That is, the ten P imi 
rate a given teac her somewhat m on 
Variables of warmth and of intr! dence 
Was due, in part at least, 19 the correspo nao oe 
within the teacher of these two types d the train- 
This may be interpreted to me? ilization of 
ing of teachers, instruction? in 
тшне motivation are qu 
essful if the student teacher d to ac- 
the attributes of warmth, or CA^ Бе helpe 
Quire them. 


Summary and Conclusions 


This re h was structure ies, wit 
ега] pattern of teacher competence en белгі 
he purpose of identifying воше tering 
that relate to desirable pupil IP 
lection ofthe teacher antec 
етапа, and intrinsic MOH 5 
rationale as to teacher pehaviors pi] behaviors. 
cally cort ip e to the changing 0! Pat rable pupil 
he selection of the consequent, 


learning (interest in science), rested upon jud, 
ments as to what constitutes i — 
able school objectives. о IUSTUM 

The sample included 1045 ninth-grade b 
girls and their 38 general science Fe a seek been 
19 public schools in eastern Massachusetts. 

The design of the research included control of 
four factors which might affect the criterion 
scores for classes: school subject, grade level 
sex of pupil, and father’s interest in science ! 

Pupils within а class agreed closely in their 
ratings onthe variables of warmth and of intrinsic 
motivation, with reliabilities between . 88 and . 93 
for the stability of within-class responses. Pupil 
agreement on the variable of demand was less 
high, with reliabilities between . 78 and . 80. 

The Science Interest Inventory, a measure of 
voluntary science activities, provided the criter- · 
ion scores. Its reliability, as determined by the 
split-half technique and corrected by the Spear- 
man-Brown formula, is . 97. 

Analysis support ed the conclusion that the 
classroom science teacher can ex pe ct pupils to 
agree in general as to how they perceive him; he 
can also expect some divergence of individual pu- 
pil impressions. 

A testofthe differences among theclass (teach- 
er-group) means of pupil ratings indicated in the 
teacher sample a diversity for each teacher be- 
havior variable, significant at the . 001 level. 

A major difference was found betweenthe means 
for the 584 boy and the 452 girl science interest 
scores, with boys reportingsignificantly more ac- 
tivities than girls (. 001 level). 

An hypothesis that the teacher variable of de- 
mand is non-linearly related to pupils' interest in 
science was rejected. No significant relationship 
was found for these two variables. It was sug- 
gested that the evidence from this research indi- 
cates that tensions оуег school work are not nec- 
essarily detrimental to such broad learning ођјес- 
tives as interest in the subject matter. 

An hypothesis that the teacher variable of util- 
of intrinsic motivation is positively relat- 
ed to pupils’ interest in science was accepted. 
The within-classes correlation for boys was . 32 
and for girls was .42, with both significant at . 001 
level. Further analysis demonstrated that the 38 
separate correlations for boy classes are equiv- 
alent, and the 34 зераг ate correlations for girl 
classes are equivalent; any variations can be at- 
tributed to chance. 

An hypothesis that the teacher variable of 
warmth is positively related to pupils' interest in 
science Was accepted, with positive and highly 
significant (.001) within-classes correlations of 
.20 for the boys and . 28 for the girls. 

A multiple correlation analysis demonstrated 
that 25% of the variance in pupils' science inter- 
est scores can be accounted for by a knowledge of 
the variation in scores for the teacher's utiliza- 


ization 
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tion of intrinsic motivation and for the father’s 
interest in science. 

it was hypothesized that the interaction of the 
teacher variables might weaken or Strengthen one 
another's effect onthe pupils’ interest in Science, 
Analysis, however, revealed по Significant inter- 
action effects. 

The findings for boththe boy and the girl sam- 
ples were remarkably similar throughout the an- 


Deman 
and Utilization of Intrinsic Motivation. 4 


1. There is growing eviden 
tions are in close agree 
type measures of teacher traits, (Projective.. 
type measures of personality variables are 
frequently considered more valid than other 
types ofinstruments.) Teacherg? self-ratings 
show low relationships with either of these, 


ce that pupil percep- 
ment with projective- 


2. For a more detailed discussion of the bases 
for this and succeeding hypotheses, the read- 
er is referred to the original dissertation. 


3. At the ninth-grade level in Massachusetts pub- 


10. c 


- While the wit 


“ Ackerman, W, |, 


Ы Amatora, Sister Mary 


- Barr, А 


lic schools, the Science course offered is al- 
most exclusively general science. 


This variable wasof an exploratory nature and 


is not sufficiently germane to ђе discussed in 
this article, 


These variations can be attributed to chance. 


The questions previously asked about the rela- 
tionships of M and I can be repeated for the 
relationships of W and I. Only the major fea- 


tures of the latter are necessary for pres ent 
purposes. 


hin-classes correlation of F and 
lis moderately Strong, the differences among 
F scores for classes are Significant only at 
the . 05 level, Adjusting for such differences 
does not reduce greatly the unaccounted -for 
variance of T Scores for classes, 
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Бар ОБ STUDIES have demonstrated that 
design pation in an experimental learning program 
ciatio ed to develop an understanding and appre- 
dyn де of the nature of human behavior and the 
does тс factors operative in social situations, 
ince caer increase e of social 
bou (10, 13, 14, 16, 20). 

ndefined as an awareness of 


epe ingeneral. It invo 
x a willingness to S€ 1 
Sus БА others. А causally oriented person will 
exin judgment until 5 ufficient 
Seque le. He realizes that his beha 
Solvi nces, and that there à 
onal © most social problems 
Йй ге understanding of the concept 
Tio Spect to measurements апар 
ка “~ detailed theoretical discussio 
ea of social causality can be found i 
qure (8), che eat or the Preventi 
the rogram at the State University 9 1 
al e е sloping а causally Peate to 
Ghat ШЕ program in an attempt to investigate 
extent social causality contributes to sc 
justment and mental health (12). = 
сан that is, an under standing of the ар 
lie res of behavior, the effects of behavio 
portance of thinking in P 
bis considering both cau ses nd effects. E 
in ea e arises whether Ss, WHO nave particip! 
earning program rimarily : 
x а more P h ar ou Zh understandin 
mor ay and human motivation: 
€ thorough understanding f 


vior has con- 


(12). He has a func- 
of probability 


redictions. 
of the con- 


the 


operate in the physical world and 
plain natural phenomena. ВИДЕНО Бу 
In analogy to the definition of i 
E Social i 
the concept of physical causality might аар 


аѕ: 


i. An awareness of some of the f 

| . 2 orces - 
ing in the physical world, and the common 4 
that cause an event or а phenomenon in the ки 


cal world, 
2. An awareness thatthere are frequently mul- 


tiple factors ora complexity of factors involved in 
a given eventor phenomenon in the physical world 
3. An awareness of some of the common scie Е 
tific procedures and methods of fact finding Е 
4. An awareness that knowledge of a given fai 
tor, force or dimension as represented by а eed 
urement of it, is limited since any measure is ге 4 


ап approximation, 
5. An awareness of the fact that if knowledge is 


basedon approximations, predictions based i 

knowledge are also only approximate, ш 
6. An awareness of the fact that scientific 

knowledge grows and may change as new informa- 


tion is accumulated. 


ral science teaching has not iven 

o the development of hinding in ль 
In a study by Fitzgerald and Ojemar р 
no correlation was found between scores on a pr b- 
ability concepts test and number of delet in ү 
high-s с hool natural science study. The н с, 
conclude '*... по relationship between an u ced 
standing of the dynamic conception of petes ipei 
measured by the test and number of semesters ot 
science is indicated.” (3) In view of this Же 


Natu 
tention t 
ity terms. 


he staff of the Preventive Psychiatry 


Не the author was on t 
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] analysis and IBM processing. 


he statistica 
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i imental causal learning pro- 
Е aie to develop a functional теш ы 
sen ability, one might expect some trans 
ues from the social causality learning program 
e 


an exper- 
develop an 
Ppreciation of the forces that 


measurements? 
Sequences? 


The data gathered also make 


Possible the test_ 
ing of some ааа опа: 


1 hypotheses: 


4. Since intelligence facil 
ing, the measurements of ca 
lated to intelligence. Bri 


t factors 
ey have а better un. 

ing of the probabilistic nature of know]. 
аста аш ge. Itis hypoth- 
ween intelligence 
will be greater for 


Special training 
than for experimental Ss. Sensitivity to the fac- 


ing about an event, even though influ- 
tors ps E ligence, is &reatly dependent on 
oda med especially those learning experi- 
al me a are provided in the *Xperime ntal 
ence 
A rogram. 
causal p knowledge that increase 
Beo accumulation of eXperience, is 
in age, 


i 21) 
an important variable in с 4 nc нара 
it i оће ized that there wi да 
виа D. crease in scores on the орке 
causality from fifth to sixth grade. €— аре 
would be confounded by at least two facto ae 
and special teaching methods for the exper. pa 
al Ss. Therefore, the dire ct ат брен, m 
crease ought to be demonstrated on о аши 
3 T culture a causal approac 
К.» Science phenomena. On the 


ity will be greater than in Social causality. 


ences. The inaccuracy of measurements and of 
Predictions ise 

natura] phenom 
likely to be Breater 
Social Scientist, 
an understanding of cau 
equally applicable in th А 
world, Consequently, there is justification in hy- 
n experimental teaching pro- 
Sram which ; i 


The Test Instrum ents 


The following test instruments were used to 
evaluate the Ss’ knowledge anq understanding in 
© area of Social апа Physica] causality: 


a Correlation With 1 
(N = 245) for Sixt and -. 37 ( 
grade Ss 


N = 158) for fifth- 
2. The Ргођје 


m Situations Test (PST) which 


MUUS 


s describing 


consists of 22 multiple choice item 
parents, and 


interaction between peers, siblings, 
teachers. The test measures the child's willing- 
ness to be immediately punitive in а hypothetical 
Situation where no retaliation is anticipated. The 
situations involve aggressive feelings, moral 
transgressions and personal problems (7, 9, 16). 
The test has a Kuder-Richardson г eliability of 
ЫП anda correlation withintelligence of -. 12 (N= 
45) for sixth-grade, and -. 12 (№ = 158) for 
fifth-grade Ss. 
_ For both the ECT and the PST the lower score 
is the more causal score. 

3. In the following year when the study was ге- 
peated, with some modifications to be described 
later, the Problem Series Ш Test (PS III) was 
utilized as a measure of social causality. This 
change in thetest instrument appeared t 
essary since the experimental Ss appro 
ceiling of the PST and the ЕСТ. The Problem 
Series III test consists of 62 true-false items in- 
Volving various aspects of the concept of causal- 
ity in social situations. Answers can be classi- 
fied into four levels or degrees of causal under- 
Standing: 

1) No concernor awareness 2 

namics 

2) Pseudo-causal approaches 

a. Using mystical or magic 
b. Using over-generalized obs 
similar untested ви 
typin rationalizing) | Е 

3) еса опе, ога imited number of ob 

servable factors 

4) Recognizing а сотр ex 

ing for the most probable 
The problem Series III test has a 
ime reliability of . 73. 
igence is -.25 (4-1 
test-retest reliability with 010 У ; 
vening (fall 1958 to spring 1959) ^. experi 
for fifth-grade Ss; broken dong, for ба test r6- 
апа control groups the respective tes 
bi we аге .59 (М = e 
. The PhysicalCaus А 
80 multiple choice items and иа? aue 
AD to measure а SU ^ g un 
ysical causality as define above. 3 
Е Kuder- Richardson reliability on RS . The 
relation with intelligence 0%: 8 


s to behavior dy- 


al explanations 
bservation O r 
(stereo- 


test is admi i ор Б 
ministered іп arts phys 

can be utilized from eac of the ро Р 38 items 
) gal explan 


Ee Causal Test Part I (PC А 
nd mainly measures knowledge © à events in the 
ations of ^ornmon prenome anc o dominantly 
Physical world. The test involves Pa 2915 
E. first two points of OUT defin jg subscore 
The Kuder-Richardson ге iabili У. art 


is .76. The Physical Caus@ 
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consists of the remaining 22 items. м 
items were adopted by the author "ois у 
doctor al dissertation (1) for use with fifth- and 
sixth-grade Ss. Thetest in line with the defini- 
tion on page 231 involves concepts three to six: 
scientific methods, the approx imate nature of 
measurements, the approximate nature of predic- 
tions and an awareness of the changing nature of 
knowledge. While Part Iis pr edominantly con- 
cerned with knowledge of phenomena and events in 
the physical world, Part II emphasizes the prob- 
Ше үзік ofscientific knowledge. Part II 
ue to its shortness, has a Kuder-Ri З 
lability of 66. | о 
5. In the succeeding year when the 
repeated this Physical Causal Test Ani kn 
The total test of 60 items was divided into two 
forms, Form Aand Form B, of 30 items each 
The content of the items, the degree of difficulty 
and the discriminatory power of the items used in 
Form A and Form B were as similar as feasible 
so that two equivalent forms of the test were avail- 
able. The test-retest reliability of the two test 
forms over а two-week interval is . 74 (N = 72). 
The correlation with intelligence is . 45 (N = 116) 
for Form A and . 44 (М = 116) for Form B. 


Since the Physical Causal Test has not been de- 
scribed in the literature, asample item will be 
given for each of the six concepts of the definition 
of physical causality. 


1. An awareness of factors that causea phe- 


nomenon. 
What could you do to make the water in the air 


form in drops on the outside of a glass? 

А. Setaglass of ice water in а very warm 
room. 

p. Set a glass of ice water in the refrigerator. 

C. Set a glass of warm water іп а very warm 
room. 

p. Set an empty glass jin a very Warm room. 

E. Set a glass of hot water in a very cold room. 

2. An awareness of the multiplicity of factors 


that cause a phenomenon. 
Not all people require the same number of food 


calories ог food energies each day because: 

A. They do not like to eat the same thing. 

B. No two people do the same kind of work. 

C. Some days а person is hungrier than on 
other days. 

p. People burn updifferent amounts of calories 
depending whetherthey area boy or girl and 
where they are. 

Е. People burn up 2 different amount of calor- 
ies depending on what they are doing and how 


much they weigh. 


An awareness of common scientific procedu 
and methods of fact finding. d us 
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А. It proves that colds are саш 
that can be carried in clothi 
B. It shows that it might be а 
make some experiments to 
can be carried in clothing, 


C. It proves that cold, dampness and not enough 


clothing will eventually, if not right away, 
cause colds, 


Sed by a germ 
ng. 

£00d idea to 
see if cold germs 


4. An awareness 
imations, 
Two men Were measuring the Strength of the 
grips of the pupils i i 
Each Pupil had three tri 


other three on Tuesday, The Conditions were 
about the same both days, p 

children the averag 
2$ two pounds higher than t 
for several others the aver, 


that measures are only approx. 


- They got exact measurements Íorthose who 
were the same both days. 

· The children had the same st 
days but the examiners read the 
lessly. 


Tength both 
Scale care_ 


. An awareness that 
imations. 
А well-known manufacturer of ca 
duced a new tire. After many te, 


predictions are only Approx. 


worn out. He 
put the tire onthe market with a guarantee that 


the tire would last for that mileage, unless 
there were accidents and unusual driving 
conditions. Jane’s father traded in all his old 
tires on a purchase of these new tires. What 


· Anawa 
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statement about his tires would you say Шш 

be most likely true after they had been dr 

39, 000 miles? | 

A. Probably all of these tires will be ЕЕ 
at 39, 000 miles if there were no acciden 


B. If there were no accidents or unusual ӘНІНДЕ 
Conditions, all of these tir es will still 
useable at 39, 000 miles. T" 

C. If there were noaccidents and unusual eed 
ing conditions, it 15 likely that these e 
Will still be useable at 39, 000 miles, but : 
is also Possiblethat allof them will be wor 
out. | 

D. If there were по accidents or unusual e 
ing conditions, it is likely that some of th 
tires will still be useable at 39, 000 miles, 


but it is c ertain that at least one of them 
will be worn out. 


E. Probably ай of these tires wil] be worn out 


at 39, 000 miles because tires very seldom 
last that long. Th 


much because it 
there had beenn i 
ing conditions, 


reness of the change and increase in 
е. 


A student who wanted to become a farmer y 
Studying in schoo] how to keep a farm 50 it wil 


а information accurately, After the 
Student finisheq › four years passed be- 
) a manager of a farm, When ће 
did become manager, he applied to his farm 
€n in the course in soil 
hem very carefully. He 


been better to get а brand new 
book on soi fertility апа have followed it 
exactly because new ways are best. 
h 2 а good idea to find out about any 
changes in knowledge because in nine years 
there ar Sure tobe improvements in every 


MUUS © 
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Procedures 


The i 

веће бї A d two independently obtained 

pends ps the first involved 413 fifth- and sixth- 

voe ард ring the 1957-58 schoolyear; the sec- 

БЄЙ мез 113 fifth-grade 55 in the 1958-59 

the study T The procedures for both aspects of 
th thew ill be described separately. 

Рат of 1958, the following tests were 

ih amit о 158 fifth- and 955 sixth-grade Ss 

western community of 80, 000: 

Test (N = 403) 

(N = 403) 

413) 


^ Те Elementary Causal 
3 iow Problem Situations Test 

e Physical Causal Test (N = 
€ 413 Ss, 208 had participated in an 6Х- 
"ens learning program designed to develop 
Social pr са toward human behavior and 
famme oblems. The remaining 205 55 сате 
tem. pipes classrooms of the same school sys- 
А жтт attempt was made to match t he exper- 

classes with the control classes on suc 


vari: 

the же as the teacher's professional training, 

acher’s years of professional experience, 
economic back- 


th 
Seo gat age, and the socio- 
a of the students. 
the ex. causal learning program 
atry rum ofthe staff of the preventive psychi- 
in ope rogram, State University 9 
the te. ration for several years: Some aspects of 
ей training program and 
е in this learning pro 
Si ibed elsewhere in the literature (16 
diffe псе the experimental and the cont 
do in their respective mean 10 scores (sixth 
e experimental 111. 1; fifth- 


grad 1 and control 109.» 
е experimental 112. 0 and control 106. 4) and 


EA 
ince the Physical Caus Test has а ™ 
relation W! h IQ (Tables 


hi 

Te significant сог е ^ 

Sig IV), a simple analysis of € va riance de- 
n was utilized in order to control statistically 

ple of intelligence. a 
e the 55' Jatest otis IQ 

the school’s cumula- 


the 
онн. mitant varia 
Scored X of intelligence 

S were obtained from 


tive folders. 
T bee three measures of causali ere admin 
is Ds at the end of the 1 school year. ^ 
у ипе: ш differences e betes 
ku menta and control classes С at - 
ex to the special learning progra which th 
perimental Ss had bee? exposed. order to 
is ju tified, the eX- 
е Ss in 


te 
st whether this assumption 5 
ith 113 fifth-gr^ 


Perime 
t nt was repeated WI 
E 1958-59 pie year. P his second part of 
Study the following tests were administer? 
ministered in 
din the 


1. The Problem Series ш, 29 
the fall of 1958 and re-administer? 
spring of 1959. 


2. The Physical est Form 


Causal Т 


" fall of 1958. 
. The Physical С 
А а: 
spring of 1959. usal Test Form B in the 


The scores obtained durin: 

. 1 the ini i 
"ridet н n will be eder Mom сылы 
К scores obtained i ке 

t 5 
ean = ‘post-test scores", ang ше ait = 
с virg pre- and post- tests " the 
hae У ee Ж АП test scores plus eto 
Sane pe ols cumulative folders were i 
ы. се апа 62 сопїго1 55 ros 
SP uta E Ss had been in the ex а 
menal m efore. Since there were n on 
po nces between IQ scores (T: не VI) 
pre-test scores and growth scores a = 
re ana- 


lyzed by way of t tests. 
Results and Discussion of Findings 


The data pertaining to the firs 
3 t ап 
МЕ 
dem n variables are reported in T = 
‘or the sixth-grade Ss and in Table II for th eat : 
grade Ss. Table I reports the analysis "M fifth- 
jance for 245 sixth-grade Ss for the peri covar- 
PST and also for 255 sixth-grade Ss for ss БЕ 
Table II presents the corresponding data f P 
fifth-grade 55. Tests for homogeneity of es - 
for all six sets of data in Table I and T emn 
well as the data reported in Table inp UN 
dence that we are justified in von iine d evi 
sumption of homogeneity of variance а. 
_ The data obtained from the two measur 
cial causality basically support the first ps sna 
sis. Forthe Elementary Causal Test the е 
аге 19. 89 for the sixth-grade 55 (Table T) an ratios 
for fifth-grade Ss (Table П). These aon mean 
are highly significant and give ан ранне 
to the ћурої hesis that on the Elementar poe 
Test the experimental 55 res pond 51 > aa 
more causally than the control Ss pnitigantiy 
The data from the Problem situations T 
notquite as convincing, the F ratio for si goles 
Ss is 1. 94, not significant (Table I) ixth-grade 
significant at the . 001 level for fifth-gr тес 2%, 15; 
ple ID). 1 can be stated that on the Pr = (Ta- 
ations Test fifth-grade бше кою 2 lem Situ- 
more с ausally and less punitively s respond 
control Ss. The data does not warrant P ж щеш 
conclusion for the sixth-grade Ss. На : апан 
spection of individual scores indicates Qi! d 2%. 
experimental Ss approach and reach th: E о 
that is, the lowest possible score of thi peas 
an average, experimental Ss answer ie est. On 
only four out of twenty-two items which n-causally 
a number of Ss answer only zero 55. that 
items non-causally. They have little „ове ов two 
tunity to improve further and to ap a no oppor- 
show their knowledge of causality y^ Enc ада 
their knowledge and understanding of pee ene 
ity is 


SUMMARY TABLE OF ANALYSIS OF COVARIANCE OF THE 
EXPERIMENTAL AND CONTROL SUBJEC 


TABLE I 


CAUSAL TESTS FOR SIXTH-GRADE 
TS (1957-58 DATA) 


Sources df SSX SPXY SSY ss'y df ms'Y F 
Elementary Causal Test 
Methods (A) 1 1337. 4 846. 8 536. 1 361. 18 1 361. 18 19. 89** 
Within (W) 243 25365.2 2534.8 4646. 7 4393. 39 242 18. 15 
Total (T) 244 26702. 6 3381. 6 5182.8 4754. 56 243 
Problem Situations Test 
Methods (A) 1 1337.4 263.3 41.8 25. 79 1 25. 79 1. 94 
Within (W) 243 25365.2 867. 8 3241.0 3211.26 242 13. 27 
Total (T) 244 26702. 6 1104.2 3282. 7 3237. 05 243 
Physical Causal Test 
Methods (A) 1 1580.0 1192.1 899. 5 168. 88 1 168. 88 4. 13* 
Within (W) 253 26052. 1 10884. 9 14848. 3 10300. 42 252 40. 87 


Total (T) 254 27632. 1 12077. 0 15747,8 10469. 29 253 
ж Significant at the . 05 level 


**Significant at the . 001 level 


985 


моиуопая ТӯІМЯИІЧЯахя ЧО тумчпог 


TABLE П 


SUMMARY TABLE OF ANALYSIS OF COVARIANCE OF THE CAUSAL TESTS FOR FIFTH-GRADE 
EXPERIMENTAL AND CONTROL SUBJECTS (1957-58 DATA) 


Sources df 


SPXY 559 55' У ағ ms'Y F 
ENDE .————- ——_ 
Elementary Causal Test 

Methods (A) 1 


1252.0 


938.0 102.8 491.24 1 491.24 32. 1 3** 
Within (W) 156 21221.9 2220.1 2558.6 2326. 37 155 15. 01 
Total (T) 15" 2243.9 3158.1 3261.4 2817. 61 156 
Problem Situations Test 
Methods (A) 1 1252.0 580.0 268.6 241. 66 1 241. 66 22. 18** 
Within (W) 156 21221.9 235.1 1646.9 1644. 31 155 10. 61 
Total (T) 15" 22473. 9 815.6 1915.6 1885. 98 156 
Physical Causal Test 
Methods (A) 1 1252.0 1011.5 817.2 249.83 1 249. 83 6.91* 
Within (W) 156 21221.9 7389.1 8178. 5 5605.77 155 36. 17 
Total (T) 157 22473. 9 8400. 6 8995. 7 5855. 60 156 
* Significant at the . 01 level 
**Significant at the . 001 level 


18% 


snow 
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not measured adequately by this test. 

The tendency for experimental Ss to reach the 
ceiling of the Problem Situations Test after par- 
ticipating in a causal learning program has been 
found in previous studies (16). This fact made it 
necessary to develop a new test instrument for 
the measurement of social causality. The Prob- 
lem Series III was developed as a r esult of this 
finding and usedinthe follow-up Study in 1958-59. 


the ECT, the PST, and PS Ш 
a waythatthe lower Score i 
Score, while on the PCT the hj 
more causal score. This fa 
correlations between socia] and Phy sical causal 
scores and between social causal scores ang 10. 
Consequently, it is the magnitude of the COrrela- 
tion and not its direction that matters in the inter- 
pretation of findings. 

For sixth-grade Ss (N - 245) the PCT/IQ сог- 
relation is .58, on the other hand, the PST/IQ 
correlation is only -. 12, and the ECT/IQ corre- 
lation is -.29. Disregarding the negative sign | 
for reasons explained abo ve, Fisher's z test of 


differences between r's indicates in support of the 
third hypothesis that ihe PCT/IQ correlation is 
Signifcantly greater than both the ECT/IQ and 
the PST/IQ correlations. 

The correlations for fifth-grade Ss (N = 158) 
are quite similar in magnitude to those for sixth- 
grade Ss—PCT/IQ is .59, PST/IQ is -. 12, and 
ECT/IQ is -. 37, Fisher’s z test of differences 
between r’s again evidences that the PCT/IQ cor- 
relation is Significantly greater than both the ECT 
/IQ and the PST/IQ correlations. The hypothesis 
that measures of Social causality are not as high- 
ly correlated to intelligence as those of physical 
causality is Substantiated by the 1957-58 data. 

In taking а preview of the 1958-59 data in re- 
Spect to this hypothesis (Table VID, we observe 
that the PCT Form АЛО correlation obtained in 
the fall of 1958 is . 45 (N < 116) and the Form B/ 

correlation obtained in the spring of 1959 is 
-44 (N= 116). The PS ШЛ cor relation is -. 36 
for (ће fallof 1958 and -. 25 for the spring of 1959 


erences between the two 


58 findings, 
It appears tha 
prob ems is more enhanced by i 


phenomena is taught 
llectual subject and items similar to 
Қ аге not uncommon in intelligence 
ests, The ability to understand the behavior of 
others is often Considered to be related to one’s 
Own emotional make-up апа one’s personality 
rather than to one’s intellect. b) An analytic 


Ypothesis four that = 
y showa positive ganren i 
* This assumption is justifie 


andthe PCT but not f the PST (Ta- 
les Ш an ot for the e 
tive corre Не Porte 1958-59 data, all respe 


с аге significant. 
с 4 = 
lates to "Рини Dart of the fourth hypothesis re 


д es between ex erimental an 
Bag their respective ү МЕЗЕ оү between 
10/criterign terion variables In comparing the 
ехрегіте fai lables Correlations between the 
agreement је Control Ss, one observes, in 
(Table ind the hypothesis, that five out of six 
The PST/1Q со) аге іп the predicted direction. 
tutes the T e ation for fifth-grade Ss gonst 
ive insta у exception However, only in опео 


» namely the PST/IQ correlation for 


MUUS 


TABLE III 
THE CRITERION VARIABLES AND IQ FOR 


INTERCORRE LATIONS OF 
SIXTH-GRADE SUBJECTS (1957-58 DATA) 
Elementary Problem Physical 
Causal Test Situations Test Causal Test 

Intelligence Quotient 

Sixth-Grade Ss (N = 245) -.29** -.12 .58** 

Experimental 55 (N = 127) E . 02 .53** 

Control Ss (N - 118) -.29** -.21* .58** 
Elementary Causal Test 

Sixth-Grade 55 (N = 245) oper -. 48** 

Experimental 55 (N = 127) 56** -. 34** 

Control Ss (N = 118) 45** -253*+ 
Problem Situations Test 

Sixth-Grade Ss (N = 245) -.23** 

Experimental 55 (N = 127) ~ M a 

Control Ss (N = 118) -.29 
* Significant at the ‚05 level 
**Significant at the ‚01 level 

TABLE IV 
ATIONS OF THE CRITERION VARIABLES AND IQ FOR 
INTERCORRE Di н. GRADE SUBJECTS (1957-58 DATA) 


Intelligence Quotient 
Fifth-Grade 55 
Experimental Ss 
Control 55 


Elementary Causal Test 
Fifth-Grade 55 
Experimental Ss 
Control 58 


Problem Situations Test 
Fifth-Grade Ss 
Experimental Ss 
Control 55 


(N = 158) 
(N= 75) 
(N = 83) 
(N = 158) 
(N = 75) 
(м = 83) 
(N= 158) 
(N= 75) 
(N= 83) 


Problem Physical 


Elementary 
Situations Test Causal Test 


Causal Test 


_. 37** -. 12 .59% 
500% -. 15 . 53** 
-. 35** . 06 59** 
„52: -.55** 
,58%% -. 35** 
. 34** -.57** 

-. 14 

-. 08 

. 01 


* Sienifi t the - 05 level 
ignificant а 01 level 


**Significant at the - 
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i h the 
ixth-grade Ss, does the difference approac 
pw of significance. Anticipating the 1958- 


experimental Ss, thus 
Supporting the hypothesis. The respective data 
for the PS III demonstrate а Significant difference 
between ex perimental (т = -. 13) and control (г = 
-.52) Ss forthe fall, while the difference for the 
Spring administration Cesi experimental; r = 


-.40 control) approaches the . 10 е Vel of signifi- 
сапсе. 


| 58-59 Study, Suggest that the 
experimenta] learning program reduces the rela- 


7.15, № = 51). 


The fifth hypothesis, Supported by Various de. 
velopmental studies оп causality (2,4, 5 


and the 
Social world in which they live due to their accu 
mulated knowledge and experience, Inorde r to 


Пу Significant 


ferences on the Physical Causal Test. An under- 
standing of causality as measured by the PCT is 
enhanc ed by an increase in age and experience, 


There also is a significant difference on the Prob- 
lem Situations Test, while the difference on the 
Elementary Causal Test approaches the . 05 level 
of significance, Consequently, the data from the 
Sality support the hypothesis that 
sixth-grade 55 have a better understanding of 
causality than fifth-grade 55, 


ctors, Since, as was 
influential factor, its 
У way of the statistical 


ay of t tests between group 
means. In the 1958-59 administration the Physi- 


cal Causal Test Form A was admini in the 
ministered in 
fall of 1958 and the Form B in the spring of 1959. 


5 а measure of social с ausality the Problem 
Series IlItest was op 


du administered їп the fall of 1958 
and again in the SPring of 1959. This makes it 
Possible to Compare the “*perimental and the con- 
БОЇ the schoo] year and their 
вА during the School year. Table 

je bPlies the 1958.65 data for the 113 d 
© beginning of the fall 1958 schoo 
year, there were no Significant differences on the 
thept’St for the ps mi and the PCT; neither were 
here Significant differences їп intelligence. Con- 
sequently, there is rather Conclusive evidence for 

16 а5витрбоћ that the experimental Ss did not 
r he Control 55 at the beginning of the 
year on the criterion variables 
tion, 
есі of the experimental learning pro- 

г - 


he growth Score was utilized and 
Score 


аге identjca] “725 іп е 1957-58 analysis; 
s, бөлісі. Inagreement with our qu 
> the data indicate that even though t 

two groups do not differ Significantly on the pr Ga 
> ERO Series Ш the experimenta 
55 show Significantly more growth, каш 5. 15 


TABLE У 


COMPARISON OF THE MEAN SCORES OF FIFTH- AND SIXTH-GRADE CONTROL 
SUBJECTS ON THE CRITERION VARIABLES (1957-58 DATA) 


Sixth-Grade Ss Fifth Grade Ss 


N Mean SD N Mean SD t 
Intelligence Quotient 118 106. 13 10. 32 83 106. 35 11.61 . 14 
Elementary Causal Test 118 8.22 4.91 83 9.53 4. 63 1. 92* 
Problem Situations Test 118 4.88 3. 69 83 6.14 3. 32 2.52** 

Physical Causal Test 118 29.49 1.38 83 26. 45 Ч. 39 2. 86*** 
* Significant at the . 10 level 
жж Significant at the . 05 level 


***Significant at the . 01 level 


TABLE VI 


COMPARISON OF THE MEAN SCORES OF THE EXPERIMENTAL AND CONTROL FIFTH-GRADE 
SUBJECTS ON IQ AND THE CRITERION VARIABLES (1958-59 DATA) 


Experimental 55 Control Ss 
N Mean SD N Mean SD t 

Intelligence Quotient 

(Otis) 51 108.55 7. 44 62 109. 37 11. 34 46 
Pre-Test Fall 1958 

Problem Series IIT 51 21.86 5.31 62 20. 65 4.84 1.25 
Growth Scores Problem 

Series III Fall-Spring 

Score 51 1.51 4.86 62 2.40 4.54 5. 15** 
Pre-Test Fall 1958 Phys- 

icalCausal Test Form A 52 12.29 3. 15 65 13.28 3.90 1. 38 
Growth Scores Physical 

Causal Test Form B - 

Form A 52 2.88 3.42 65 1.42 3. 65 2.22* 
ж Significant at the . 05 level 
**Significant at the . 001 level 


SMW 
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(significant at the .001 level), on this measure of 
Social causality than the control Ss. Further- 
more, іп supportof the second hypothesis one ob- 
serves that even though both groups do not differ 
significantly on the Physical Causal Test at the 
time of the pre-test, the experimental Ss show a 
significantly greater mean gain during the two 
test administrations than do the control Ss, thus 
again supporting the hy pothesis concerning a 
transfer effect from the experimental learning 
program to a measure of physical causality. 

In conclusion, the data from the 1958-59 study 
give additional Support to the hypothesis that ex- 
perimental Ss grow more rapidly in their under- 
Standing of causality than control Ss. Since it was 
shownthat the two groups did not differ signifi- 
cantly on the criterion variables at the beginning 
of the experiment, it can be assumed that the 
growth in causality is a Product of the experi- 
mental causal learning program. Furthermore, 
there is justification in concluding that the exper- 
imental learning Program with its emphasis on 
dynamics of behavior and human motivation does 
contribute to a transfer effect which enhances the 


an understanding of error terms in measurement 
and prediction, and an appreciation of the prob- 
abilistic nature of scientific knowledge. 

The findings of a previous study (11) suggest a 
further problem. Is the transfer effect as meas- 
ured by the Physical Causal Test greater for the 
kind of items that are presentedin РСТ Part I in- 
volving knowledge of common phenomena and 
events in the physical world or is it greater for 
the items in PCT Part II which emphasize the 
probabilistic nature of knowledge? Furthermore, 
if there is a differential transfer effect, is it the 
same for fifth- and for sixth-grade Ss? 

In order to investigate this question the scores 
of the Physical Causal Test reported in Table I 

d Table П were broken down into their sub- 
2 es, PCT Part I and PCT Part П. In Table 
VII these subscores are analyzed by a covariance 
Lope in order to eliminate the influence of IQ 
and are reported separately for fifth- and sixth- 

de Ss. The data for sixth-grade Ss, in agree- 
prani with previous findings (11), demonstrate 
акеге is no significant difference between ex- 
x ental and control Ss on the PCT Part I. On 
E r hand, the F ratio for the PCT Part П is 
и nificant at the . 001 level. Experiment- 
= ~ тогай Ss have а significantly better un- 
oto f the probabilistic nature of knowl- 
параи 25а n control Ss, but do not differ in the 
edge th Ee oan mmon phenomena and events in 
egere Ө world as measured by these tests. 
виа Ss the findings are reversed. 

о: 


ThePCT Part I scores yield an F ratio of 11. 68, 
Significant at the . 001 level, indicating that even 
though there is no Systematic difference between 
sixth-grade experimental and control Ss, sucha 
difference exists for fifth-grade Ss. On the other 
hand, while the difference was highly significant 
for sixth-grade Ss onthe PCT Part П, there is no 
significant difference on this subscore for fifth- 
grade Ss. 

It appears that there is a treatment and grade 
level interaction effect, which only becomes ob- 
vious when the total Physical Causal Test score 
is broken down into its two subscores. Fifth- 
grade experimental Ss are better able to solve the 
kind of problems that make up the PCT Part I, 
while sixth-grade experimental 55 solve the prob- 
lems ofthe PCT Part II more effectively than their 
respective control Ss. 

The differential findings onthe PCT Part II can 
be explained fairly easily by the concepts involved. 
The items making upthe PCT Part П are relative- 
ly difficult and complex. Many of these items 
were originally developed by Clark (1) for use with 
junior high-school Ss and were adopted by the АДА 
thor for use with fifth- and sixth-gradeSs. While 
the adaptation for Sixth-grade Ss appears to have 
resulted in an appropriate degree of difficulty, the 
items do seem to be fairly difficult for both exper- 
imental and control fifth-gradeSs, and the exper- 
imental learning effect does not show on these 
items. Furthermore, the particular content of the 
experimental learning program may contribute to 
the findings on the PCT Part II, for there isa 
£reater emphasis in the sixth-grade material on 
Concepts involving probability, change of knowl- 
edge, andthe inaccuracy of measurement and pre- 
dictions. 

The findings pertaining to the PCT Part I are 
more difficult to explain. It appears that for the 
fifth-grade experimental 55 there is a real learn- 
ing and/or transfer effect whichincreases the PCT 
Part I subscore and whichis assumed to be due to 
the experimental learning program. 


many items ask for relatively Simple explanations 
and at times only for one or two factors that may 
have caused an e vent. 


teaching and since the concepts covered in PCT 
Part I would be taught in ele mentary school in а 
conventional physica] Scienceclass, such science 
teaching would indeed helpa student in Solving the 


ТАВГЕ УП 


INTERCORRELATIONS OF THE CRITERION VARIABLES AND IQ FOR 
FIFTH-GRADE SUBJECTS (1958-59 DATA) 


Pre-Test Post-Test Pre-Test Post- Test 
Fall 1958 Spring 1959 Fall 1958 Spring 1959 
PS Ш PS Ш PCT Form A PCT Form B 
Intelligence Quotient 
Fifth-Grade Ss (N = 113) -. 36** -.25** .44** .43** 
Experimental Ss (Ч = 51) -. 13 -.12 . 30 416 
Control 55 (N= 62) -.52** -. 40** .52** .58** 
Pre-Test Fall 1958 PS III 
Fifth-Grade Ss (N = 113) .49** -.38** -.39** 
Experimental Ss (N= 51) .59** -. 30% -. 32* 
Control Ss (N= 62) .56** -. 43** -.46** 
Post-Test Spring 1959 PS Ш 
Fifth-Grade Ss (N = 113) -. 31** -. 39** 
Ехрегїтепїа1 55 (N= 51) -.40** -.31** 
Control Ss (N= 62) -.40** -.44** 
Pre-Test Fall 1958 PCT Form А 
Fifth-Grade Ss (N = 113) .57%% 
Experimental Ss (М = 51) Dex 
Control Ss (N= 62) .58** 
ж Significant at the . 05 level 
**Significant at the . 01 level 


$75 
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TABLE УШ 


SUMMARY TABLE OF ANALYSIS OF COVARIANCE OF THE SUBSCORES FOR THE PHYSICAL CAUSAL TEST 
PART I AND PART II FOR FIFTH- AND SIXTH-GRADE EXPERIMENTAL AND CONTROL SUBJECTS 


Sources df SSX SPXY SSY 55'Ү df ms'Y F 


Physical Causal Test 
Part I (Sixth-grade Ss) 


Methods (A) 1 1580.0 509.6 164.4 2.06 1 2.06 .10 
Within (W) 253 26052.1 7439. 8 1553.0 5428. 36 252 21.54 
Total (T) 254 27632. 1 7949.5 7717. 4 5430. 42 253 
Physical Causal Test 
Part П (Sixth-grade Ss) 
Methods (A) 1 1580.0 682.5 294.8 133. 80 1 133. 80 12. 36* 
Within (W) 253 26052.1 3445.1 3183. 2 2727. 62 252 10. 82 
Total (T) 254 27632. 1 4127. 6 3478. 0 2861. 42 253 
Physical Causal Test 
Part I (Fifth-grade Ss) 
Methods (A) 1 1252.0 798. 0 508.6 206. 60 1 206. 60 11. 68* 
Within (W) 156 21221.9 4654.5 3762. 3 2741.51 155 17. 69 
Total (T) 157 22473. 9 5452.4 4270.9 2948. 11 156 
Physical Causal Test 
PartII (Fifth-grade Ss) 
Methods (A) 1 1252.0 213.5 36.4 2.05 1 2. 05 . 18 
Within (W) 156 21221.9 2734. 6 2132.9 1780. 56 155 11.49 
Total (T) 157 22473. 9 2948.1 2169.3 1782. 61 156 


* Significant at the . 001 level 


РРС 
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TABLE IX 


COMPARISON OF THE MEAN SCORES OF THE EXPERIMENTAL AND CONTROL FIFTH-GRADE 


SUBJECTS ON TWO SUBSCORES OF THE PHYSICAL CAUSAL TEST (1958-59 DATA) 


Experimental 55 Control Ss 
N Mean SD N Mean SD t 
Pre-Test Fall 1958 Phys- 
ical Causal Test Form A 
Part I 52 8.50 2.55 65 9.15 3. 02 1. 26 
Growth Fall-Spring Phys- 
ical Causal Test Form 
ВТ-АТ 52 2.08 2. 62 65 .58 2.59 3. 05* 
Pre-Test Fall 1958 Phys- 
ical Causal Test Form 
A Part II 52 3.79 1.82 65 4,12 1.95 .95 
Growth Fall-Spring Phys- 
ical Causal Test Form 
ВП-АП 52 81 1.98 65 .83 2.50 . 05 
*Significant at the . 005 level 
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kind of problems which appear in PCT Part I but 
not thosein PCT Part П. These explanations are 
Speculative, and there may be others. 

Nevertheless, itis obvious that the nature of 

the items in PCT Part Iis basically different 
from those in Part П. This is also indicated by 
the moderately high correlation bet ween these 
two parts of the Physical Causal Test. The cor- 
relation between the PCT Part I and PCT Part II 
subscores is .42 (N - 158) for fifth-grade Ss and 
-44 (N = 245) for sixth-grade Ss, indicating that 
the two parts of the PCT measure t wo different 
aspects of the S's understanding of his physical 
environment, since the amount of variance that 
can be accounted for by the correlation of the two 
measures is 20 percent. 

The question arises when the 1957-58 study 
was repeated for fifth-grade Ss in 1958-59 whether 
the findings wereduplicated. Inspection of Table 
IX supports the findings from the preceeding year, 
even though growth measures are utilized. On 
the pre-test scores of both PCT Part I and PCT 
Part II there are no significant differences be- 
tween experimental and control Ss. On the growth 
measure, obtained by subtracting the pre-score 
from the post -score, there is а significant dif- 
ference on PCT Part I but not on PCT Part II. 
This is an exact duplication of the 1957-58 data, 
even though the revised PCT test contained only 
half as many Part I and Part П items. The as- 
sumption that the increase in score is due to the 
experimental learning program is sub stantiated 
by the fact that in the 1958-59 data there existed 
no known differences on the criterion variables at 
the beginning of the experiment. 

These findings show that onthesetwo subtests 
of the PhysicalCausal Test the learning effect of 
the experimental program affects fifth- and sixth- 
grade Ss differently. Further investigation is 
needed to satisfactorily explain these findings. 


Summary 
Summary 


i N = 208) and control (N = 205) 
паре sixth-grade classes were com- 
ss emp respect to their mean scores on meas- 
pared “а of social and physical causality in order 
par гін the effect and the transfer effect of 
D iR ealth learning program which is de- 
yes developan understanding and apprecia- 
signed + e motives of human behavior and an 
tion of t ofthe dynamics of factors operating in 
памте. tt tions. Data were analyzed using а со- 
у iet in order to eliminate the influ- 
yama on the findings. —' 
um findings of the study allow for the follow 


ing generalizations: 


- The experimental learning program sub- 


stantially contributes to an understanding 
of the dynamic, complex, and variable na- 
ture of human behavior in fifth- and sixth- 
grade Ss as measured by the ECT. 


- The learning program reduces a fifth-grade 


S's willingness to be punitive as measured 
bythe PST. Whether it does so for sixth- 
grade Ss cannot be assessed clearly due to 
certain limitations of the test instrument. 


- The learning program has a transfer effect 


for fifth- and sixth -grade Ss on an under- 
Standing of the causes of common events 
and phenomena in the physical world and an 
awareness of the probabilistic nature of 
knowledge as measured by the PCT. 


- The transfer effect is different for fifth- and 


sixth-grade Ss. Fifth-grade experimental 
Ss have abetter understanding of the factors 
that produce a common event, as measured 
by the PCT Part I, than their control Ss. 
Sixth-grade ex perimental Ss have a better 
understanding of the probabilistic nature of 
knowledge, as measured by the PCT Part П, 
than their respective control Ss. Further 


investigation is needed to explain this phe- 
nomenon, 


· Measures of physical causality have a high- 


er correlation withIQ than measures of so- 
cial causality. 


- There is a tendency for experimental Ss to 


obtain lower correlations betweenthe meas- 
ures of causality and IQ than is the case for 
control Ss. It appears that the learning pro- 
gram increases a S's understanding of so- 
cial and physical causality regardless of the 
S's level of intellectual functioning. 


. There is а developmental increase in under- 


Standingof causality as measured by the 
ECT, PST and PCT from fifth- to sixth- 
grade for controlSs. This increase appears 


to be greater in the physical than in the s0- 
cial science area, 


- Using fifth-grade Ss and modified test in- 


Struments inthe subsequent year, most find- 
ings Were duplicated. Since it could be dem- 
onstrated that no known differences existed 
on the criterion variables at the beginning 
of the experiment, the follow-up study pro- 
vides substantial evidence for the assump- 
tion that these effects are due to the exper- 
imental learning program. 


+ While one cannot draw conclusions beyond 


this particular experimental learning pro- 
gram and beyond the specific test instru- 
ments utilized in this study, the findings are 
Supported in general b y other studies con- 
ducted as part of the Preventive Psychiatry 
Program (10, 13, 14, 16, 20). 


10. 


11, 


. Deutsche, Jean M. 


· Judd, С. Н. 


· Levitt, E. E. «рий 
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A COMPARISON OF SCORES OBTAINED 


BY ADMINISTERING А TEST NORMALLY 
AND VISUALLY * 


H. A. CURTIS and R. P. KROPP 
Florida State University 


T on IS A REPORT of the first of a series of 
bilit es designed, in part, to ascertain the feasi- 
Fem d of administering via television group stan- 
2T tests which are com m only used in the 
ic schools. Since an increasing amount of in- 
visi ag the medium of tele- 
Mn m it is relevant to inquire 
to ght also be done by television 1n 
obtain, on the one hand, the me results for 


мн as would be obtaine 
Frid normal conditions, and, on the other hand, 
th obtain more valid results than = e afforded by 
е usual method of administration. so, itis 

afforded by 


ole vant to explore the pos sibilities aff 
m with respect to gaining test. deu 
pean y cannot be obtained by ве. traditional Р” 
egi сиве tests due to шо, Mi imit 
я is report deals only W! nini 
Pre un а to pee ру television а inistration 
ed results which are compar? 
pipes normal administrative conditi 
Ап examination of television? 
n to communicate test rial evealed 
protien of problems. The most notable, 
mi ped is the precise metho | by which th 
йш t be presented within the limiting D 
is <i a by the nature of television. , 
Usual inistered under norm дол i d 
low A inform the examinee of e 
RA and then to present nim wi er LE rinde 
he S: He ede determine the 2^ items he 
vl d spend on each item; pep 
e attempt, and to re-attenn е ue 
had previously omitted. 


televisi 
levision screen preclu es 


51 
pau ев to the student» nistrati 
oma parenitted in the BOT ipo pest ЈЕ Fe 
i n pstan- 


of 
Senet will be denied him 
ented by television. 


ti 
ally different test administr 
testing. 


used for television 
the article- 


* 
Е 
Ootnotes will be found at 


, The technique which is reported here is called 
pacing. It involves the serial presentation of 
one test item ога small group of items at a time 
until all items in the test have been exhausted. It 
does not allow the examinee to refer back to items 
which have previously been exposed. A single 
presentation of an item or group of items is re- 
ferred to as an exposure. The duration of the ex- 

osure is called the intra-exposure interval. The 
time elapsing between the end of one exposure and 
the beginning of the next exposure is called the in- 
al. Theserial exposure of 


ter-exposure interv: 
small portions of tests, with the exposures pos- 
sibly being separated by notice able intervals of 


time, makes possible presentation of test mater- 
ials by television. However, it is radically dif- 
ferent from normal procedure and itposes new 
variables in the administrative tec hnique which 
must be studied. 

In addition to the variables already mentioned 
there are at least the following: item-order i- 
tem-type, audio and/or visual presentation, kind 
of test (intelligence, achievement, adjustment 
essing instructions, etc. : 
pility of using the pacing technique 
ibility of setting valueson these 


hinges on 

variables that will have the effect of producing 
test results comparab! 
been obtained under normal administrative condi- 


tions. The following is a desc ription of a first- 
attempt in this direction. 


problem 


The general problem reported on here was a 
study of the changes in test scores of a group of 
ho were administeredthe same test un- 
ts of administ r ative conditions. 
s of conditions are as follows. 
ion of the test was done in confor - 


with normal procedures, i.e., pupils were 
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given test booklets, answer Sheets, etc. This ad- 
ministration is subsequently referred to as the 
**control'" administration. The other two sets of 
administrative conditions were e Xperimental in 
nature and involved project ing test items on a 
Screen as the method of presenting the test to the 
subjects. One of these experimental administra- 
tions consisted of presenting test items one ata 
time to the examinees and it is referred to as the 
"single" presentation. The other experimental 
administration involved presenting the items three 
at a time and is referred to as the “triad” ad- 
ministration. More explicit descr iptions of the 
experimental conditions appear in the subsequent 
section. 

The following comparisons were m ade of the 
Scores obtained under these three sets of con- 
ditions: means, frequency of response, guessing, 
and the factor patterns of each set of scores. 

Although the over-riding purpose is to deter- 
mine a feasible method of administering tests by 
television, the experimental administrationsof 
the test were not done by television due to the ex- 
pense and awkwardness which it would have en- 
tailed. Items were reproducedon slides and were 
projected on a 3'x 5'screen. Slide format con- 
formed to the format of the TV screen. The il- 

lumination level maintained in the testing room 
was comparable to that maintained for TV view. 


ing. 
Procedures 


Sample. The sample consisted of a ninth- 
grade class of white students. Complete Set sof 
test data were collected from twenty-nine of the 
class members. Four students from whom in- 
complete test data were gathered were discarded 
prior to the analysis of the data. № 

Tests. The following tests were administered 
to the subjects under normal conditions: 

School Ability Test, Form 3A, of the Coopera- 
tive School and College Ability Test 

Jowa Test of Educational Development, Form 
x393, Tests 3-7 | 

Test 3. Correctness and Appropriateness of 

ion 

disti. ABUS to do Quantitative Thinking 

Test 5. Ability to Interpret Reading Materials 

i ial Sciences 
fest ве ся to Interpret Reading Materials 

i tural Sciences 
dent Lae pales toInterpret Literary Materials 
Thurstone ‘Temperament Schedule 
Gordon ж Fisica 

ersonal Inven 

weg асам Mental Abilities, ages nar. 
Iowa Silent Reading Test, New Edition, Ad- 


d Speed and Accuracy of theDifferential 


Aptitude Test? 


The School Ability Test was administered nor- 
mally and experimentally. А11 other tests men- 
tioned above were administered to provide data on 
the basis of which to evaluate the differences be- 
tween the results obtained from the normal and 
experimental administrations of the School Ability 
Test. 

The School Ability Test was used asthe exper- 
imental іеѕіб, Тһе test consistsof four parts. 
Parts I and III assess verbal abilities, and Parts 
II and IV assess quantitative abilities. Onthe ba- 
Sis of item analysis data supplied by the Educa- 
tional Testing Service, the test was broken into 
two half-tests, thus permitting the use of a half- 
test for each set of experimental conditions and 
thereby eliminating item overlap between the two 
experimental administrations. Data dealing with 
the comparability of these half-tests appear in 
Tablel. The column entitled “N” indicates the 
number of items in each part of the half-test. | 

Experimental Conditions. There were simi- 
larities and differences between the experimental 
conditions under which the half-tests were admin- 
istered on two occasions. The similar conditions 
were as follows: no inter-exposure interval, all 
items were five-choice multiple choice, the total 
testing time devoted to item solution was the same, 
directions were the same, and the mode of item 
presentation was visual. 

The chief differences between the experimental 
administrations were the number of items pre- 
Sented per exposure, the intra-exposure interval, 
and the order in Which the items were presented. 
,, Тһе single item administration presented one 
item per exposure, The expos ure duration was 
determined by dividing the number of items in- 
cluded in each part of the test into the amount of 
time the test authors allotted for that part of the 
test. Since the number of items and time allowed 
differed from part to part of the test, the ехроѕ- 
ure interval was not constant throughout. The 
following durations were used: PartI, 30 seconds; 
Part П, 48 seconds; Part Ш, 20seconds; and 
Part IV, 60 Seconds. The items within each part 
of the half-test were presented in the same order 
in which t hey appeared in the parent test, thus the 
item order was that of ascending difficulty. 

The triad administration presented three items 
рег exposure. The exposure interval for each 
Part was three times that allowed for the single 
item administration, The item order within each 
Part was determined in this way. Triads were 
Constructed to һауе the same mean difficulties 
and ranges, insofar as possible. Within a triad, 
items were arranged from least to most difficult. 
Since it was impossible to make the range of dif- 
ficulty for each triad exactly the same, the triads 
Were arranged from greatest to least range. ІП 
short, the order of items within a triad presente 
a rhythm of difficulty--simple, average, difficul 
~-which was repeated throughout the entire test- 
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TABLE I 


COMPARISON OF HALF-TESTS DEVISED FROM THE SCHOOL ABILITY TEST 


Form A Form B 
Part p Sigma p range N р Sigma ТА 
1 .48 .24 .14-.91 15 .48 .20 .07-.15 
п „41 .24 . 09-.91 13 AT .23 .09-.84 
ш „45 21 .11-.82 15 -45 .23 .14-.95 


TABLE I 
VIATIONS ON HALF-TESTS FROM SAT, 3A 


MEANS ANE STANDARD DE 
Mean S.D. 


11.068 5.98 
н 16.757 6.00 
wis 15. 619 3.62 
ini 14. 930 3. 86 
ай 17.930 6.05 
күз 18.102 6.92 
d 15.378 3. 64 
XQS 15. 550 3. 74 
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The reader will note that thirteen items are 
contained in each of Parts П and IV of the test. 
Actually fifteen items were used in each so that 
there would be five triads. Two were borrowed 
from the comparable part ofthe other form. 
However, these borrowed items were not scored. 

Testing Schedule. The tests were administer- 
ed in two sittings, the first preceding the second 
by a period of three months. The first sitting in- 
cluded the normal administration of the School A- 
bility Test and the five tests of the Iowa Tests of 

Educational Development. These tests were ad- 
ministered in half-day sessions on three consec- 
utive days. 

The remaining tests were administered over а 
three-day period as follows: First day, morning 
--Gordon Personal Profile and Gordon Personal 
Inventory; afternoon--single item experimental 
half-test. Second day, morning--SRA Prim ary 
Mental Abilities; afternoon--triad experimental 
half-test. Third day, morning--Thurstone Tem- 
perament Schedule, DAT Clerical Speed and Ac- 


curacy, and Test I of the Iowa Silent Reading Test. 


Experimental Directions. Special directions 
and sample items were used when administering 
the experimental test. The directions were dis- 
tributed, one copy to each subject, and were read 
aloud by the examiner while the subjects read 
them silently. Prior to the presentation of each 
of the four parts of each experimental test,special 
directions were given and a sample item was ex- 
posed on the screen. Subjects were atno time in- 
formed of the amount of time they could spend on 
each exposure. They were informed thatno ques- 
tions could be asked during the administration of 
any part of the test. They were informed in the 
instructions that they would not be able to refer 
back to items which they might not have answered 
when they had been presented. | 

No unusual circumstances aroseduring the ad- 
ministration of the experimental tests. 


Results 


i Means. The School Ability Test 
рана ва тете under normal conditions 
ге-зсогеа several times to gain scores over 
нена which appeared in the half-tests. In ac- 
cordance with customary usage of the School A- 
bility Test, Parts I and III were combined to pro- 
vide а verbal score and Parts II andIV were com- 
bined to provide a quantitative score. 
The means and standard deviations are oue 
sented in Table II on the previous page. In is 
ble, and hereafter, the follo wing code is em- 
| а to conserve space: C, control; X, experi- 
ced V, verbal; Q, quantitative; S, single; and 
Е i all sets of data were gathered ена 
the same subjects, it was necessary Tum eoms 
puting t tests of mean differences to make c 


tions for correlated performances. The relevant 
intercorrelations appear in Table Ш and the t 
tests appear in Table IV. 

The following generalization m i ght be tenta- 
tively drawn from the tabular data. The XT ad- 
ministrative conditions lead to higher scores than 
do the XS conditions. On the verbal section, ei- 
ther experimental condition produces higher mean 
Scores than does the control administration. But 
apparently no generalization can be drawn for the 
quantitative items: CQS and CQT meansbracket 
the counterpart X means despite the fact that the 
CQS and СОТ means should be equal on account of 
the method used to build the half-tests. 

The tendencies described above must be re- 
garded skeptically becausethe t tests revealed 
no significant differences between the means ex- 
cept in one case. Furthermore, one might attrib- 
ute the apparent, although not significant, super- 
lority of XT to XS to the fact that XT data were 
gathered subsequent to the XS data thereby re- 
flecting practice effect. 

In summary, the data to this point do not gen- 
erally indicate, at the .051evei , differences in 
mean scores which are functions of administrative 
conditions. However, the control data were col- 
lected three months prior to the collection of ex- 
perimental data. Nevertheless, the intercorrela- 
tions which appear in Table Ш indicate that sub- 
jects would fall in roughly the same order on the 
experimental test as they were ordered by the 
control test, Thus, the data to this point would, 
in a limited Way, lend support to the administra- 
= tests by television if a pacing technique 15 
used. 

Comparisons by Item Types. The preceding 
analysis dealt with means on the Q and V sections 
of the test inasmuch as Q and V scores are gen- 
erally reported when the School Abi lity Test 15 
used. However, the Q and V scores, respective- 
ly, are established by summing success over two 
parts of the test each of which has relatively 915- 


tinct kinds of items. Sample items illustrate this 
difference, 


Verbal 
Part I We had worked hard all day so that by 
evening we were quite ( ју 
А. small B. tired С. old 
untrained E. intelligent 


Part III Chilly 


А. tired B. nice C. dry 
D. cold E. sunny 


Thus, the items in part I contain a sentence 25 
à stem, whereas in Part Ш the item stem 15 
merely a stimulus word. 


Quantitative 
Partll 5413 А. 586 в, 59g С. 696 


-4827 D. 1586 E. None of these 


_ - 
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TABLE III 


CORRELATIONS BETWEEN SCORES ON CONTROL AND 
EXPERIMENTAL HALF-TESTS OF SAT, 3A 


хут CQS сот XQS XQT 


CVS 
сут 869 .865 
хуб „854 
хут 
15 .789 
cas 8 687 
. 650 703 
сот 
753 
XQS 
XQT 
N - 29 
TABLE IV 
RRECTED FOR 
> AN DIFFERENCES со 
«t» TEST OF ML ATED PERFORMANCES 
сов сәт хаз хот 
хз ХТ 
cvs СУТ 
-1.59 
суз ‚55 2.03 
-1.99 49,017 
СУТ 
- .25 
XVS 
хут 1.60 .53 .12 
CQs -. 76 -. 73 
сот -.25 
XQS 
хот 
жр „05 


М = 29 


253 
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PartIV Four $10-bills are equal to how many $5 
-bills? 
A. 20 B. 10 C. 8 
D. 40 E. 2 


Thus, the items in Part П consist of stems 
containing a set of numbers andan operations sign, 
whereas the items in Part IV consist of stems 
which are statements of word problems involving 
arithmetic. 

Analyses were done to determine whether dif- 
ferences existed between success on particular i- 
tem types in association with different conditions 
under which the items were admin istered. The 
relevant data appear in Tables V (means and stan- 
dard deviations), VI (inte rcorrelations) and VII 
(Ғв) on the next pages. 

The tabular data reveal for the items inthe two 
verbal parts of the test that regardless of whether 
the item contained a verbal statement or not the 
experimental administrative procedures led to 
slightly higher mean scores than did the normal 
administrative conditions. Whether this is due to 
the effect of the experimental conditions or the 
fact that the experimental data were coll ected 
three months after the control data is very much 
in doubt. On the quantitative items a differential 
in response accuracy is associated with method of 
test administration. On the quantitative items 
having statements for stems, the experimental 

administrations led to higher mean scores than 
did the control administration. However, on the 
quantitative items which had for а stem a series 
of numbers and an ope rat ion sign, the control 
means were significantly different from andgreat- 
er than the experimental means. This finding is 
ment. 
ыа nod the reduced m ean scores on the 
NE s no-stem items is attributable to any 
: all of the following, since the problems were 
a involved the examinee probably copied the data 
from the screen to his scratch paper in order to 
solve it, thus 1) reducing his working time due to 
the time involved in copying, 2) committing cler- 
ical errors when copying, 3) after solving the 
roblem, needing to locate a Similar ВОВЕ Dn. 
а screen during which errors in remember ing 
might have occurred. Only further research will 
vide definite knowledge of the reasons for the 
P ced scores. It should be noted at this time, 
= h, that non-responsetothese items was sig- 
tidie less than the amount of non-response on 
the same items when administ er ed normally. 
Whether the poorer performance is due simply to 
guessing or to factors noted above is problemati- 
cal. any — 
factor worthy of specific mention is 
dad сүбелі. of the quantitative T 
with regard to method of administration are of a 
er magnitude than comparable intercorr ela- 
Tee for the verbal items. Generally the lowest 


intercorrelations are based on the no-statement 
quantitative items. 

Analysis of Omits. It was hypothesized that 
Subjects would be more likely to give a greater 
number of responses to the items when experi- 
mentally presented than when normally presented 
simply because all items would be exposed to the 
examinees on the experimental administration 
whereas on the normal adm inistration their test 
taking habits might have caused them to omit 
Some items. Also it was hypothesized that there 
would be no difference in response frequency be- 
tween the triad and single experimental presenta- 
tions. Both of these hypotheses held at the .05 
level of confidence. The Wilcoxon Matched- Pairs 
Signed-Ranks Test was used incomputing the sig- 
nificance of differences, The pertinent data are 
presented in Table VIII. 

Thus it appears that the experimental test ad- 
ministration procedures, i.e., pacing examinees 
over all items, leads toa greater number of item 
responses than does the normal administrative 
procedure during which the examinees are re- 
Sponsible for their own pacing. 

Although differences in non-response are а5- 
Sociated with mode of test administration, the 
data were analyzed to determine if non-response 
was related to certain personality variables on 
one kind of administration but not on the other. А 
response accuracy score was calculated for each 
examinee on the basis of his responsesonthe Х@5 
and CQS administrations, Separately. The ac- 
curacy score fora Subject was equal tothe ratio 
of his “rights” score tothe total number of items 
he responded to. The score was computed in this 
way to discount differences in ability which would 
effect the subject's probability of non-respons e. 
The personality variables whi ch were evaluated 
with regard to response accurac y were “Сал- 
tiousness” from the Gordon Personal Inventory 
and “Reflective” and ‘‘Impulsive’’ from the Thur- 
Stone Temperament Schedule. A 2 x 2-X.2 anal- 
У515 produced the results shown below. 


Cos response accuracy 


VS Cautious "X? = 00 pi> 03 

YS Reflective -X_2 = 2,28 po 209 

vs Impulsive -X 2. 56 р> 05 
XQS response accuracy 

VS Cautious “x 2 = 65 p> .05 

vs Reflective -x 2. 00 p> »ВЕ 

vs Impulsive — -x 2. 00 po, 08 


The data indicate that tendency to omit itens 

not related to these three personality variables 
Оп either the norma] or experimental test admin- 
istrations. 

Intercorrelations, The intercorrelations be- 
tween control and experimental administration? 
of the experimental tests appearin Table IX. The 
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TABLE V 
STANDARD DEVIATIONS OF PART SCORES ON 


MEANS AND 
HALF-TESTS FROM SCHOOL ABILITY TEST 
~ 
пи Verbal itati 
Condition Si NS**(II Condition S(IV Quantitative NS 
% sigma X sigma X sigma X re 
CVS 8.52 3.89 8.55 2.94 CQS 6.48 2.01 9.14 2.11 
хуз 9.24 2.98 8.69 3.28 XQS 7.24 1.79 8.10 2.26 
CVT 8.45 2.96 8.31 3.46 сот 6.45 2.01 8.48 1.45 
хут 8.79 3.97 9.31 3.51 хот 8.24 2.18 7:31 2.37 
М = 29 * stem **no stem 
TABLE VI 
TESTS 


PART SCORES ON HALF- 


TIONS BETWEEN 
CORRENA FROM SCHOOL ABILITY TEST 


Quantitative 


Verba sa NSUN Variable Pair Sv) КУ) 
М г г 


Variable Pair 
r r 
CQS-XQS .58 ‚71 


CVS-XVS лт 8 
е сот-хот 259 248 
CVT-XVT 46 07 
1б XQS-XQT .54 ET 


XVS-XVT QU 


N = 29 


TABLE УП 


RRE 
NCES BETWEEN co 
22 DIRE GM HALE-TESTS OF SCHOOL A 


LATED MEANS OF 
BILITY TEST 


Quantitative 
Suv) NSM) 
t 


Variable Pair 
t 


TABLE X 


ROTATED FACTOR MATRIX* 


Tests I II III IV 
01 CVS 9470 -0593 -0261 0279 
02 CQS 1105 0607 -0826 -0001 
03 CVT 9382 0903 -0619 -0032 
04 CQT 6866 -0693 -1172 0164 
05 Control Total Score 9616 -0272 -0680 -0206 
06 XVS 9172 0117 0096 1013 
07 XQS 6916 -2285 1308 -1153 
08 XVT 8979 0640 1574 -0131 
09 XQT 6983 -0933 0288 -2227 
10 Gordon Ascendancy 1945 -8023 -1591 0575 
11 Gordon Responsibility 2244 -0709 7513 -1007 
12 Gordon Emotionally Stable -0769 2919 5357 -0118 
13 Gordon Sociability -0349 -8326 0611 0615 
14 Gordon Cautiousness 0177 -1044 8164 -0262 
15 Gordon Original Thinking 3424 -3108 6156 0625 
16 Gordon Personal Relation 0506 1643 7077 0675 
17 Gordon Vigor 3675 -1835 2388 -1200 


0450 
-5216 
0695 
-5056 
-1538 
1002 
-5205 
1715 
-3572 
-0468 
0539 
1544 
-2651 
0581 
-0842 
-1656 


0848 


1028 
1367 
0778 
-0170 
0797 
2484 
0192 
0254 
-0874 
0624 
2756 
3273 
0428 
-1055 
1408 
-3099 


1920 


уш 


-0497 
-1388 
0302 
2789 
0447 
0740 
-1300 
0266 
1214 
-0155 
-0272 
0488 
-1051 
0201 
0299 
-0778 


-3291 


865 


хомуопал "IVLNSINDISdX3 AO TVNUNOL 


18 Thurstone Active 


2162 -5710 -2405 1607 -3380 -0101 0045 -1353 
19 Thurstone Vigorous 0141 -2368 0327 6066 0033 2479 -0151 0150 
20 Thurstone Impulsive -0334 -5266 1619 -1468 -0926 0039 4332 -1165 
21 Thurstone Dominant 0551 -8274 -0373 -2266 0864 1955 -1445 1761 
22 Thurstone Stable 0084 -3282 2241 -6277 -0572 1103 -0068 -0376 
23 Thurstone Sociable -2000 -8546 2144 0256 -0628 0359 -0068 0164 
24 Thurstone Reflective 1779  -0469 0887 3048 1842 1023 1308 4205 
25 PMA Verbal Meaning 8326 1297 0700 2128 2912 1519 0246 -0742 
26 PMA Space 3468 -0397 -4441 2464 1892 1527 2155 1830 
27 PMA Reasoning 4617 0644 -1080 -3836 4377 0240 -0485 1625 
28 PMA Number 6178 -2343 -3273 -0321 1393 1792 1419 -3654 
29 PMA Word Fluency 6544 -0806 2111 0169 0016 -1743 1670 -3978 
30 PMA Scholastic Aptitude 8401 0214 0320 1102 4630 1406 0120 -0016 

31 DAT Clerical Sp. and Acc. 3204 -0672 0410 1342 6190 0276 -0068 -0371 

32 Iowa Silent Reading Rate 5785 -0459 0503 3930 1196 0843 -2257 1481 

33 Iowa Reading Comprehension 8074 1520 0140 0178 1090 -2649 0221 1216 

34 ITED Correct Expression 8864 1020 1034 -2423 0852 1187 0409 -0125 

35 ITED Quantitative 7562 -1799 -0538 0121 -0746 -3008 -1130 -1024 

36 ITED Social Studies 8527 0642 0200 -0307 -0138 0829 -4265 0980 

37 ITED Natural Science 8050 0542 1314 -0053 -0844 0956 -3647 -1054 

38 ITED Literary Material 8681 0084 -0433 -0720 -0921 1863 -3272 0304 

* All decimal points omitted. 
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аи ӨЛЕН ТНЕ Pearson product moment 
of rel Por coefficient has been used as an index 
than 50 ionship between two variables for more 
contro years, there continues to be considerable 
Which i concerning the circumstances under 
and 1958 use is appropriate. As recently as 195 
Comm The American psychologist carried 
(5), тазы Бу Nefzger and Drasgow V» Furfey 
tion of orge (6), and Milholland (1) on the ques- 
ттық елесі ог not it is necessary (0 assume 
ations y in thedistributions оп which 
ticle in T based. Binder, Ша 
ed to sh he American Psychologist 
misdi ow that much of the controversy 
rected because ог a lack of understand! 
the со he interpretation 
Tin aao coefficient. 
that differe athematical models, Bi 
correlation к inferential interpret atio 
Mathem, ion coefficient grow out 0 е 
егепсе шеп models and concludes, E де 
Benera] or the bivariate normal mod rep rei 
Power model stems from its great de* рр 
ations and its usefulness in many empiric 
"s 
sume extent to which failure to sa 223 
terpr ion of bivariate no r mality d storts the О 
was rotation of the product moment C a 
1929 th Subject of numerous studies in Sonn 
d rough 1932. Egon pearson rore dis 


of 


e 
place of assumptions in t 
y developing three . 


llege for Teachers 


cation 


from 5 to 52, and i istri 
butions from 50 coefficients to iu sd 
the work sampling distributions were based Rum 
or fewer correlations, and Baker's study (the onl 
one which raised serious question about the di s 
tortion of the obtained sampling distribution) Ee 
based on only 50 samples of size 40. 

The current study was undertakenina 
to pin down any empirical effects of PE à 
by taking larger numbers of samples than hed 
been used previously anddetermining the obtained 
sampling distribution in each case. Sample sizes 
used were in the range of ones frequently en- 
countere d in educational and psychological re- 
search. Several types of nonnormality frequently 
encountered in such research were used, and the 

pulation correlations of zero and . 83 represent- 


ed the range of values usually encountered. 


sample sizes 


Ten populations of sizetenthousand were estab- 
lished. A population having approximately по cor- 
relation and a population having substantial corre- 
e established for eachofthe following bi- 
ormal, rectangular, leptokurtic 
markedly skewed. The ten 
nto one set of ten thou- 
sand IBM cards. The ten thous and cards were 

order by ordering four columns 
of random digits. The samples were obtained by 
nting off the desired number of 


The deck was sampled without replace- 


uct: 
tribua a series of studiesin which їп var- 
ious ions deviated from bivarial enorm" distri- cards. i 
utig 278 and concluded tha! tne sampling Фе тој | ment und toeimadtion, Thaideck wah Boo 
x of the product moment efficien' ede py using another set of four co lumns of random 
іса] usly effected by failure tO t пега! digits and samples counted off. This was г epeat- 
cong, sumption. His findings мете Eti ons by ed twenty-four times ince de? tovobtidtite desired 
Du jan by other empirical i est (3) and number of RT cach за tbi ы. 
Ri den (4), Chesire, Oldis, з в pivariate ders P4 г data being identical ~ о. 
тын 12. Baker (1), dealin8 23 marginal fre” leaving п totalofone hundred columns for ees 
Quengrution with markedly skewed Moz size oTt | digits. Saga ple Bizas 18, 20, вон о were ор. 
the obtain a р ems was 2150 skewed tained concurrently with the first two samples of 
ted that рте distri се would be mis- | fize 15 comprising tis first sample ofsize 30, and 
РР | за os he emis etr coca 
Met ay оке РЕ: e studi i first 5а 5 7... 
Bi ош the normal in воћа! беш ss and кино“, жеге calculated for the samples and sampling dis- 
ulati zo 4 і і 
ation correlations rang rsuant toa contract withthe Office of Education, United 
u. 


“Тһе ге іп W 
St search reported herein i 
ates enone of He th, gducatio 
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tributions for sample sizes 15, 30, and 90 were 
established for each of the ten populations. As 
indicated in Table I, the sampling distributions 
consisted of 15,984 coefficients for sample size 
15; 7,992 coefficients for sample size 30, and 
2, 664 coefficients for sample size 90. The sam- 
pling and calculating were done by means of the 
IBM 650 Data Processing System. 

The obtained sampling distributions were com- 
pared with the appropriate theoretical sampling 
distributions assuming bivariate normality and 
with the obtained sampling distributions from the 
bivariate normalpopulations. Fisher's transfor- 
mations, 


were used in establishingthetheoretical sampling 
distributions. The obtained and theoretical sam- 
pling distributions were tested for overall good- 
ness of fit by means of Kolmogorov-Smirnov tests. 
Critical values were established for г.005, г. 025, 
г. 975, and г. 995 and frequency tabulations made 
of the number of significant co efficients in each 
of the obtained sampling distributions. 


Results 


The obtained sampling distributions from the 
normal (control) population having no correlation, 
approximated its theoretical distribution very 
closely. The Kolmogorov-Smirnov goodness-of- 
fit test showed no departure from the theoretical 
distribution for samples of sizes 30 and 90, and 
the discrepancy between obtained and theoretical 
distributions for sample size 15 was significant 
only at the . 20 level of significance. The close- 
ness of the fit even in this case was remarkable. 
Inspection of Table II and Graph 1 will also show 
that for the normal case the relative incidence of 
significant correlations conformed very closely to 
the theoretical proportions. 

The close correspondence of the obtained and 
theoretical sampling distributions where the pop- 
ulation correlation was approximately zero and 
the score distribution approximately normal was 
interpreted ав providing assurance ofthe adequacy 
of the sampling procedures used in this study. In 
particular, the effects of using discrete, finite 
populations in place of the theoretical continuous 
and infinite populations did not appear to materi- 

ally influence the results. Nor did sampling pro- 
cedures, as such, appear to cause deviation of 
the empirically determined distributions fromthe 

ical expectations. 
a rem sampling distributions based on 
a rectangular population conformed very closely 
to their theoretical distributions. However, the 
Kolmogorov-Smirnov test indicated a significant 
departure between the two for sample size 15. 


Although the probability of such a discrepancy 
occurring by chance alone was less than .05, the 
magnitude ofthediscrepancy was small. Inspec- 
tion of Table II and Graph 2 will also show that 
the incidence of significant correlations did not 
deviate markedly from the theoretical propor- 
tions at either the 05 or . 01 levels of signifi- 
cance. All considered, there was little evidence 
that sampling from a rectan gular distribution 
produced sampling distributions markedly differ- 
ent from those obtained when the assumption of 
bivariate normality was met. 

The obtained sampling distributions based on 
а leptokurtic population deviated from their theo- 
retical distributions in the same fashion as did 
those based on the normal population, but the 
magnitued of the discrepancies was much greater. 
The differences were significant at the . 05 level 
for samples of size 15 and 90 (see Graph 13). For 
samples of size 90 significant correlations were 
obtained only . 69 as often as expected at the . 05 
level of significance and . 60 as often as expected 
at the . 01 level. Although there was some evi- 
dence that the sampling distributions of correla- 
tion coefficients basedon a leptokurtic population 
tended to be leptokurtic also, the departure from 
the theoretical distribution was not very great. 

The obtained sampling distributions based оп 
slightly skewed or markedly skewed populations 
appeared to bear very similar relationships to 
their theoretical distributions. Kolmogorov- 
Smirnov tests on the six com parisons indicate 
no significant departure from the theoretical T 
tributions at the .20 level of significance ex сер 
lor samples of size 15 based on the markedly 
Skewed population. The de parture in that case 
Was one which could occur between ten and шее 
percent of the time by chance alone. Referents 
to Table II and Graph 5 shows that even here th 
relative incidence of significant coefficients di 5 
not de viate markedly from theoretical expecta 
tions. Only in the fact that there was a tenden- 
to have too few significant negative correlation’ 
and too many significant positive correlations Уа 
there any suggestion that sampling distributio 
vo on skewed populations would be skew 
also. 

, № general, it was concluded that for popula- 
tions in which there was no correlation the Sm 
Pling distributions based on nonnormal mM. 
tions did not differ markedly from those whe ва 
the theoretical assumptions of normality coul as 
met. For samples as small as 15 or as large ју 
90, the critica] regions contained approximate, 
the correct proportion of extreme coefficients а 
either the . 05 or -01 levels of significance. e 
of the theoretical distribution in place of 5071 
ОЕТ ехасі sampling distribution would not 967. 
iously influence the probability of making erro 
of the first king. 


à oí 
Sampling distributions based on samples 


= 


NORRIS - HJELM 


TABLEI 


BER OF SAMPLES FOR EACH EMPIRICAL 


SIZE AND NUM 
SAMPLING DISTRIBUTION 


Population 
Correlation 
Small Large 


15,984 7,992 2,664 


Number of Samples 


Marginal Distribution 
N-215 N=30 N= 90 


Normal .000 .835 

Rectangular .000 .831 15,984 7,992 2,664 

Leptokurtic .000 | .809 15,984 7,992 2,664 

Slightly Skewed -.005 .826 15,984 7,992 2,664 
-.004 .826 15,984 7,992 2,664 


Markedly Skewed 


TABLE П 


PROPORTION OF OBTAINED COEFFICIENTS IN CRITICAL REGION (р = . 00) 


.01 Level of Signif. 


.05 Level of Signif. 
Both Lower Upper 


Both 


Marginal Distribution Population Lower Upper 
gina stri Correlation rail ‘ail Tails Tail Tail Tails 
15 К .0258 .0513 .0051 .0059 .0110 
тинт +.016 15 “09248 .0260 ‚0507 '0048 .0065 .0113 
Rectangular -.019 15 10244 .0227 .0471 0053  .0053 .0106 
Leptokurtic sos 15 “0220 -0256 0476 10052 .0063 0115 
Slightly Skewed or 15 “0208 “0299 .0507 “0036  .0078 .0114 
M zi 
arkedly Skewed аб 10218 10255 .0473 .0053  .0054 .0106 
Normal +.016 30 “0226 0228 .0454 10058 .0048 .0105 
ne бе -.019 20 10219 -0223 ‚0442 .0051  .0043 .0094 
eis ce -.00% 20 0226 .027% “0498 “0046 .0068 .0114 
Slightly Skewed E 30 20213 +0302 8 ЖШ чи um 
Markedly Skewed у 0259 -0229 .0488 .0060  .0056 .0116 
а +.016 2 “0252. -0225 ‚0477 -0034 .0034 .0068 
ыы M XA RE — s0345 Qul “071 roe 
Ји геа а – 008 20 “0199 10267 . 0465 үз ‘ МЕ .0113 
ei dime Р 2,010 90 0236 “9248 .0484 . .0068 .0105 
ightly ewe -.012 


Markedly Skewed 
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size 15 and 30 froma bivariate normal population 
having substantial со г relation (р = -83) deviated 
from their theoretical distributions atthe . 01 lev- 
el of significance. For sample size 90 the Kol- 
morgorov-Smirnov test did not yield a significant 
difference at the . 20 level, However, the devia- 
tion of the obtained and theoretical distribution in 
no case was extremely pronounced, Inspection of 
Table Ш shows that for both tails combined the 
incidence of significant coefficients approximat- 
ed the theoretical number at the - 05 апа. 01 lev- 
els of significance. However, there was a general 
tendency for there to be proportionately too many 
significant results in the positive tail of the dis- 
tribution and proportionately too few in the nega- 
tive tail. This disparity decreas ed as sample 
Size increased, 

The deviation of the obtained Sampling distri- 
butions from the theoretical ones based on the as- 
sumption of normality of distribution for Fisher’s 
statistic cast doubt onthe validity of that assump- 
tion for values of rho as great as .835. For the 
purpose of determining the effect of nonnormality 
of population distributions on the sampling distri- 
butions of the product moment coefficient, the ob- 
tained versus theoretical comparisons seemed 
somewhat inappropriate. Consequently, the ob- 
tained sampling distributions based on nonnormal 
populations were comparedalso with the obtained 
sampling distributions based on the normal popu- 
lation. 

The empirical sampling distributions for all 
sample sizes from the re c tangular population 
having substantial correlation deviated from their 
theoretical distributions at the . 01 leve] of sig- 
nificance, This departure was in the Same direc- 
tion as inthe normal control population, but the 
deviation was much more pronounced. Table ПІ 
shows that the critical regions of the obtained 
distributions in no case contained more than . 477 

of the number of significant coefficients obtained 
from the normal population. The disproportion- 
ately low incidence of significant coefficients be- 
came more extreme for increased s ample size 

d for the lower level of significance. In one 
tati of the sampling distribution based on samples 
of size 90, there were no d UM found as low 

ical value of r, 005. 

as “ је өзе evidence indicated that the зат- 
pling distributions of product moment coefficients 

arectangular population were much 
Paara loni kurtic than either their theoretical dis- 
more Тер "ar the өнбей distributions based on 
M eal елінен, Af tbe ПЕ NEL of signifi- 
a normal рет combined, the empirical 
Еден tained between . 381 and . 214 of 
Loses ни Кеа nificant correlations found in the 
the number o = tions based on the normal рор- 
enya анына 01 level of significance the cor- 
пайва tie ortions were.254 and . 079. Rec- 
responding propo d to have a pronounced effect 
‘angularity appeare 


on the sampling distributions of the product mo- 
ment correlation coefficient. 

There was strong evidence that the sampling 
distributions based on aleptokurtic population 
containing substantial correlation were substan- 
tially more platykurtic than either their theoreti- 
cal distributions or the obtained sampling distri- 
butions based on a normal population. Table III 
shows the proportions of significant coefficients 
in all critical regions were higher than anticipat- 
ed from the theoretical distributions and from two 
to more than seven times as great as those ob- 
tained from the normal population. 

All Sampling distributions based on skewed 
populations having substantial correlation deviat- 
ed from their theoretical distributions at the . 01 
level of significance. Table Ш indicates that all 
critical regions at the . 05 and . 01 levels of sig- 
nificance contained agreater proportion of signif- 
icant correlations than expected from the theoret- 
ical distributions anda still greater proportion 
than found in the empirical distributions based on 
the normal populations, 

Several general observations seemed warrant- 


ed on the basis of the data from this study. They 
are: 


_ 1. When there was essentially no correlation 
in the population, the shape of the sampling dis- 
tributions for the product moment correlation со- 
efficients did not vary markedly as a function of 
nature or extent of nonnormality in the bivariate 
distribution, In Бепега], these obtained sampling 
distributions conformed very closely to their the- 
oretical distributions, , 
2. When there Was substantial correlation in 


the population, the Shape of the sampling distri- 
bution based ona bi i 


tic for values of rho as great as . 835. ; 
3. When there was Substantial correlation in 
the population, the sampling distributions based 
on nonnormal Populations deviated from their the- 
em igal distributions and from the distribution 
empirically deter mi ned for a bivariate normal 
Population. The nature and direction of the devi- 
ation was Specific to the type of nonnormality in 
the population, 50 me sampling distributions ар- 

pearing leptokurtic and others being platykurtic. 
+ 1 SCrepancies between proportions of the- 
oretical and obtained significant correlations were 
relatively greater at the . 01 level of significance 
than at the , 05 level. Some of the obtained sam- 
pling distributions contained too many correlation 
coefficients in the extreme tails and too few coef- 
ficients in the Iess extreme sections of the tails- 
In other sa m pling distributions the reverse was 
true. Due to the ines nsistency of the effects of 
nonnormality on the tails of the sampling distri- 
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bution, it did not appear possible to adjust for 
nonnormality by modifying the level of signifi- 
cance in either direction. 

5. When there was substantial correlation in 
the populations, increased sample size appeared 
to accentuate the discrepancy between the ob- 
tained sampling distributions and either their the- 
oretical distributions or the empirical distribu- 
tion on a bivariate normal population. 

6. Sampling distributions basedon skewed pop- 
ulations yielded disproportionate numbers of sig- 
nificant correlations in the two tails of the dis- 
tribution whether there was correlation in the 
populations or not. Where rho was approximate- 
ly zero, the two-tailedtests yielded approximate- 
ly the expected proportion of extreme coefficients, 


but one-tailed tests based on the same distribu- 
tion did not. 
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PUPIL DISCOVERY VS. DIRECT 
INSTRUCTION * 


WILLIS E. RAY 


Ohio State University, 


EMPIRIC AL EVIDENCE does not support any 


A consistent set of hypotheses with regard to 
fee relative efficacy of pupil disco very versus 
T dominated direct instruction (1, 2, 6, 14). 
Ed is particularly true as these teaching meth- 
ісе relate or interact with Levels of intellectual 

ility of pupils (7, 8, 10). 

It was the purpose of the prese i 

) to provide addition tal and applied 
research evidence as to the ffect of di- 
Зара discovery, in situations providing numer- 
pes problem solving opportunities, Upo; 
аазы, retention, and transfer of mi 

'easurement principles and skills 25 compared 
With traditional direct and detailed instruction in 
hese situations, with threelevels of intelligence. 


nt investigation 


The Problem 

5 {һе изе 
E 

ruct thel nis method 


Many teachers inst 
nstruction. 


of direct and detailed i 
i ар characterizec 
this e specific goal of ef 4 
is method, thesubject m? 
FO емей to the pupils in ге 
the + er poses problems and proc 
in ask of solving these problems | 
ud opportunity for the pupil 
ie pay of solution or principle in 
liste ion. The learner is ac 
ples ning to and presumably 
Sie procedures for 
егы presented. и а 
With ly memorize the prin 
Yit fully understanding 
aft ious items or steps which are P 
er the other by the teacher. 
њи ~ questions might be ke 
and detailed instruction. 


О 
eS the pupil retain ideas, 
а 2) how W} 


le 
агпед іп this way? ап 
i jon submit 


* А 
This report is based 
- at The University 


eeds 
without allow- 


upon : 
of 1111018. 


Columbus 


pupil apply this newly obtained materialto new 
and related situations? 
Studies in retention of learning reveal that ac- 
tive involvement of the learner in the learning 
situation retards forgetting (6, 11, 12). Research 
in transfer of learning has indicated that specific 
“rules” dealing with qu antitative problems at 
least temporarily blind the learner so that he fails 
to adapt a learned approach to solve effectively 
novel problems requiring somew hat different 

techniques for solution (5, 13). 
g which wouldallow the pu- 


А method of teachin: 
pil to become “active” in the learning situation 


may possibly have positive effects with regard to 
retention. И the pupil is allowed to discover re- 
lationships and methods of solution for himself 
make his own generalizations and draw с onclu- 
sions from them, he may then be better prepared 
to make wide applications of the material learned. 
It is entirely possible that adirected discovery 
method of teaching may be most effective with 
pupils of high mental ability. Likewise, itis pos- 
direct and detailed method of instruc- 

most effective withpupils oflow men- 
tal ability. The use of direct instruction, repeti- 
tion, and drill have been common techniques used 


with the slow learner. 
From these postulations the following hypothe- 


ses were generated and tested: 
15 difference in initial learning 


facts and principles, abil- 
and actual manipulative 
rmance) between groups taught by Method A 


ethod B. 


2. There is no difference in retention of ma- 


terial initially learned as measu red one and six 
after instruction between groups taught by 

A and Method B. 

о difference in the ability to 

the knowledge acquired as 

ix weeks after instruction be- 


Method 
There is n 


transfer effectively 
measured one and $ 
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tween groups taught by Method A and Method B. 
4. There is no interaction between the two 
teaching methods employed and the low, average, 
and high intellectual levels with regard to initial 
learning, retention, and transfer of learning. 


Procedure 


Experimental Design. A treatments Xlevels 
design was employed in the experiment. Two ex- 
perimental teaching methods (A and B) and one 
control (C) (no instruction) constituted the three 
treatments, and the three levels (high, aver age, 
and low) were determined with reference to men- 
tal ability (Pintner IQ) assumed to be related to 
the criterion. The levels were introduced to in- 
crease the precision of the design. 

The independent variables were 1) methods of 
instruction and 2) intelligence. Тће dependent 
variables were 1) initial learning as measured 
immediately following treatment, 2) retention and 
transfer as measured one week after treatme nt, 
and 3) retention and transfer as measured six 
weeks after treatment. The controlled variables 
included 1) content and method of presentation un- 
der Method A andlikewise under Method B, 2) 
length of instruction, 3)illustrations, 4) precision 
measuring equipment, and 5) testing and testing 
conditions. 

The Sample. The 135 Ssinitially selected for 
usé in this experiment were sam pl ed at random 
from all ninth grade boys enrolled in the three 
junior high schools of a medium sized (35,000 

population) midwestern community. All 158 a- 
vailable Ss were assigned to the three levels by a 
«counting off" procedure suggested by Lindquist 
(4). By independent random sampling, 1855 were 
assigned to each of the experimental treatments 
within each of the three levels, апа 9 Ss were as- 
signed to the control group within eachof the three 
levels. Fifteen Ss were lost due to absence dur- 
ing the six weeks of the experiment, and 3 Ss 
were eliminated at random to bring the number 
Ss in each experimental cell to 15. No Ss were 
lost in the control group. Therefore 117 Ss were 
considered in the descriptive an alysis of attri- 
butes and in the analysis of the criterion data. 

Due to the effects of random sampling, nosta- 
tistically significant differences were found to 
exist within comparable cells with reference to 
intelligence, standardized achievement, and age. 
The Ss were quite representative of the general 
population of ninth grade pupils with regard to so- 

à i atus. 

uo mà The zero to one inch micro- 
meter caliper, a precision measuring instrument, 

elected to be used in the teac hing-learning 
was 5 s of the experiment. Ss were taught the 
and functions of the parts, facts about the 
micrometer (readings to .001 inch) 
(readings to . 0001 inch) principles 


proces 
names 
instrument, 
and vernier 


involved in reading the tool, and how to manipu- 
late and read the instrument for actual measure- 
ment. 

Instruction. Ss weretaught in groups of nine, 
each group being composed of three Ss from each 
of the three ability levels. The teaching-learning 
Session was 47 minuteslong. Common introduc- 
tory material was presented to both treatment 
groups for the first 7 minutes, and the remaining 
40 minutes were devoted to differential treatment. 
To assure constancy of conditions from one in- 
Structional group to another, tape recordings 
were used of all oral instruction and 35 mm slides 
were used of all illustrations (same set of 22 
Slides used with both groups). 

The control group was given no instruction. 55 
in this group merely took the five criterion tests 
to determine how they would perform without in- 
Struction. : 

Method A, as developed, represented a tradi- 
tional approach to teaching skills and understand- 
ings, that of ‘‘direct and detailed" instruction 
spoon feeding, or the “те! and do’? method. ВУ 
this method, the teacher presented the learning 
material, reviewed important points, and solved 
Several examples related to the material without 
any pause other than normal sentence break 
throughout the forty minute session. 

Method B, on the other hand, could be char" 
acterized as а method ој“ directed discovery * 
By this method the pupil was called upon to be ас- 
tive, to carefully study illustrative material = 
his own, and contemplate leading questions aske 
by the teacher. In Method B, 48 percent of the 
treatment time (19 minutes out of 40 minutes) was 
Spent in silence which allowed the Ss to react 19 
the leading questions, discover principles; m 
make generalizations, Very few positive state 
ments of fact and none of principle or gene rali- 
Zation were given orally by this method. | 

Criterion Measures, Threetesting periods 
were used to evaluate the effectiveness of instruc- 
tion. Immediately following treatment, the t 
tial Learning criterion test was administered ( 
minutes), The Ss were given no indication Ша? 
testing would occur one and six weeks after treat- 
ment. One week after instruction, the Retenti s 
One Week and Transfer One Week criterion Ее 
Were given (100 minutes). Ata period six wee 
after instruction the Retention Six Weeks ane 
Transfer Six Weeks criterion tests were admin 
istered (100 minutes). а 
_ AL tests were work limit or power tests m 
involved both performance and paper and рейс. 
items. The initial learning and retention 165 
involved actual measurement of guage blocks T 
the micrometer caliper (performance) and pap 
and pencil items designed to test knowledge = 
facts and principles relatedto the use of the РГ {8 
cision measuring instrument. The transfer йел 
involved both performance and paper and pen 
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items that attempted to measure application of 
knowledge gained to new but related situations. 
Performance with and knowledge of the depth mi- 
crometer caliper, the vernier caliper, and the 
vernier protractor (basic princ iples of use the 
Same as with the vernier micrometer caliper) 
Were measured by these transfer tests. 

Subtests and part scores г esulting from the 
tests were carefully analyzed by corr elational 
techniques. Аз a result of this analysis, total 
test scores were determinedby the sum of the raw 
Scores of subtests. 

Reliability (equivalence) с 
from .92 to . 97 were obtaine 
lon tests by the Kuder-Richardson 
mula 21) estimate. 

Statistical Treatment. а A 
IBM cards and various electronic machines in- 
cluding the digital computer were employed in an- 
alyzing the data. The analysis of variance tech- 


nique was used together with appropriate supple- 
ity of variance. Сог- 


mentary tests of homogene! 
relational reis c other methods employed 
were selected because of their adequacy in геј ыз 
fin ty the-data, The:. 05 level of contidence Ses 
beyond was considered significant for Ара?" 
9f this study. 


oefficients ranging 
d for the five criter- 
Case IV (For- 


Data were punched on 


Findings 
The control group was inc 
he experiment to determine 1) 
Pupils used as Ss had prior kno Wl? 
earning task, and 2) if == а testing be- 
Scores on tests subsequent to initi rious in- 
Cause of learning from the tests, vica 
instruction or communication am 
stings, or personal study. 
S in the control group 
indicates that none of 
Parently operating in the 


ed inthe design of 


i ninth grade 
if the the 


lud 


Only the 90 experimental Ss We? 
1 perimental :terion data. 
ing the statistical analysis deinde ]-- There iS 


Test of Hypothesis 1. НУР 
no dise НУР ee earning (knowl? 
3 rence in initial vility t so 


Се facts and principles, АО, 
ems, and actual manipulative Р Method 
Ween groups receiving регіо ed on the 
4n analysis of variance 5 is iS presented i 
Obtained data, and this analys! 
able I, ! т treatment 
The analysis shows that the а unt fora Statio" 
есі and interaction (T jg variance 25895 
ically insignificant amount f е пе groups: ed 
Clated with the learning 500165 0 паі are presen 
boest indicates that differences is ity level 
‘tween groups can be i ated E scores 
inle à 5 
r is, Significant difference? рит mi A 
151 between levels only- e sinc the € 
Sard to levels was an anticipated Ө 4 fference® 
Periment was designed to develop 
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between levels. Resting on the data obtained and 
the statistical technique employed to analyze these 
data, the null hypothesis regarding initial learning 
is tenable. 

Test of Hypothesis II. Duringthe early design 
of this experiment, the investigator hypothesized 
that Ss receiving Method A would learn much 
more initially than those Ss receiving Method B. 
Of concern also, during the design stages of the 
experiment, was the fact that although Ss receiv- 
ing Method A may learn more initially, they may 
not retain as much of what they initially learned 
as that retained by Ss receiving Method B. With 
this in mind, Hypothesis П was formulatedas fol- 
lows: 

Hypothesis II-- There 15 по difference in reten- 
tion of material initially learnedas measured one 
and six weeks after instruction between groups 
receiving Method A and Method B. 

The clause ‘еге is nodifference in retention 
material initially learned" ог what they did in 
factlearn, was designed so that anexamination 
would be made of the difference between the ini- 
tial scores and scores made at one and six weeks. 
This technique of analysis would reveal whether 
Ss receiving Method Aor Method Bretaineda 

reater proportion of what they initially learned. 

To test this hypothesis, analyses of variance 
were performed using difference scores and the 
results are revealed in Tables II, III, and IV. 

It can be seen from а study of Table П that 
there was no significant difference in difference 
scores between treatments one week after in- 
struction. Since the available data offer insignif- 
icant evidence against the null hypothesis (АПА = 
Allg) this null hypothesis is thus tenable. 

However, during the ensuing fi ve weeks, the 
group taught by the direct and detailed method 
failed to retain as much of what they didlearn 
when compared with the reten tion of material 
learned by 55 instructed by the directed discovery 


method. Р 
The analysi 


of 


s that supports this statement fol- 
lows. Since the F-value for treatments obtained 
from Table II is significant, the avail able data 
offer evidence against the hypothesis of no differ- 

се (А1бд = 516ӊ). Bartlett's (езі о! homogen- 
ен of variance produced a chi-square of 1. 327 
ely 5 = 3.841). This test gives sup- 


alue at .0 
(ao the belief that the variances of the two 


homogeneous. Sincethe F-test 
г sum “ne HA resulted in the rejection 
applie ull hypothesis, and since Bartlett’s test 
of the ted that it 15 not the variances that differ 
inaita antly, it appears that the significant value 
sie ia the result of a difference in the means of 
о 


: es (016). 
the dift е difference scores obtained by 


ce of the scores attained one 
tion and ће scores SiX weeks 


after instruction, the evidence indicates that at 
e 
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TABLE I 


ANALYSIS OF VARIANCE OF LEARNING SCORES ON INITIAL LEARNING TEST 


Source Sum of Squares df Mean Square F 
Treatments 313.7 1 313.7 1.041 
Levels 15, 624.8 2 7,812.4 25. 920* 
Treatments х Levels 596.7 2 298.4 = 
Within Sets 25,318.8 84 301.4 

Total 41,854.0 89 


* Significant F at .05 - 3.11 Significant F at .01 = 4,87 


TABLE II 


ANALYSIS OF VARIANCE OF DIFFERENCE SCORES BETWEEN INITIAL 
LEARNING AND RETENTION ONE WEEK 


Source Sum of Squares df 


Mean Square F 
Treatments 48.4 1 48.4 = 
Levels 291.7 2 145.9 1.616 
Treatments X Levels 365. 2 2 182.6 2.022 
Within Sets 7,584. 3 84 90. 3 
ЫБ 8,289.6 89 


i 8 initial 
ix weeks, the Ss taught by the directed discovery The difference scores obtainedfrom the ini 
SİX Wi ЕД 


Е : де 
method (Method B), retained a relatively larger ee and Retention Six Weeks dato y Jut 
А aterialthat they had at their сот- y2ed іп Table IV. The p. val ue о 034 c 
proportion of m treatments provides Significant evidence 
and one week after instruction when compared jection of t 
m 


he null hypothesis of A16 4 = Al ёв; 
ith Ss that received Method A. However, Bartlett’s test of homogeneity 
У 


TABLE 


RIANCE OF DIFF 


ANALYSIS OF VA 
E WEEK AND 


RETENTION ОМ 


Sum of Squares 


211 


ш 


ERENCE SCORES BETWEEN 
RETENTION SIX WEEKS 


df Mean Square Е 


864.9 8.701% 


Treatments 864.9 
Levels 30.4 
Treatments X Levels 168.3 

8,350. 5 


Within Sets 


1 


2 15.2 = 
2 84.2 ^ 
84 99.4 


89 


Total 9, 414.1 
Significant F at .01 = 6.95 


* Significant F at .05 - 3. 96 


TABLE 


LYSIS OF VARIANCE OF DIFF 
I 


AND RE 


IV 


ERE 
TENTION 


NCE SCORES BETWEEN 
SIX WEEKS 


ANA 
NITIAL LEARNING 
1 1,322.5 9. 333* 


Treatments 1, 322.5 
Levels 419.4 
Treatments X Levels 220.3 
Within Sets 11,904. 8 

Total 13,927.0 


96 


* Significant F at .05 = 3. 


2 239.1 1.692 
2 110.2 E 
84 141.7 
89 


Significant Fat.01- 6.95 
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iance provided a significant chi-square of 
5.258 (table value at .05 = 3. 841 апа at .01 = 
6.635). Nevertheless,an F as large as 9.333 ob- 
tained from Table IV may bethe result not only of 
heterogeneity of variance, but also the result of a 
significant difference in means. 

A t-test can be performed even though the var- 
iances are found to be heterogeneous. The stand- 
ard error of the difference in means is calculated 
by using one-half the degrees of freedom available 
(n-1 rather than пд+ пв - 2). А t-value of 3.054 
was obtained using this procedure (table value at 
.05 = 2.015 and at.01- 2. 691). Therefore, the 
null hypothesis of ДІбА = AI6p is not tenable. 

Hence the АПА = АПВ portion of Hypothesis II 
is tenable. The AI6A = AI6B portion of the re- 
Search hypothesis must be rejected. 

Test of Hypothesis III. Hypothesis Ш--Тћеге 
is no difference in the ability to transfer effec- 
tively the knowledge acquired as measured one 
and six weeks after instruction between groups 
receiving Method A and Method B. 

Data were collected by means of the Criterion 
transfer tests given one Week and six weeks after 
instruction. The results of the analyses of var- 


portion of the variance between groups. The var- 
iance associated with levels in both analyses is a 
large part of the total variance. 

A significant difference in main treatments 
effect is present both at one and six weeks after 
instruction. At one week the F-value of 5.158 is 
significant beyond the .05 point. Bartlett's test 
of homogeneity of variance produced an insignifi- 
cant chi-square of 1. 003 (table value of chi-square 
at .05 = 3.841). Therefore, the variation between 
the variances of the two treatment groups is well 
within the limits of random Sampling from a pop- 
ulation with a common variance. Hence the null 
hypothesis of o5 = сБ is tenable. It can be con- 
cluded from this that the difference is inthe 
treatment means. The significant F provides 
support for the inference that Method Bis super- 
ior to Method A with regard toa relatively wide 
application of learning as measured one week af- 

i ction. 

e after instruction the analysis of уаг- 
iance supplies ап F of 10. 885 which is significant 
beyond the . 05 point. A chi-square of . 678 ob- 

ined from Bartlett's test of homogeneity of var- 
m is not significant (table value at.05 - 3, 841). 
Sanctions, since the null hypothesis of 02 = ogis 
tenable, the basis for the significant vàlueof Е 
must be the difference between the means of the 
— р & presented and the statistical 
E used in analyzing these data, Hypo- 
hesi ПІ must be rejected. The alternative hypo- 
ts is that the mean scores of the treatment 


groups are not equal must be accepted. This 
leads to the conclusion that Method B is superior 
to Method A in producing transfer under the con- 
ditions of this experiment. b 

Test of Hypothesis IV. Hypothesis IV-- There 
is no interaction between the two teaching metho > 
employed and the low, average, апа high intellec- 
tual levels with regard toinitial learning, reten 
tion, and transfer of learning. is 

Data pertaining to this research hypothesis 
have been presented incidentally while testing Hy- 
potheses I through Ш. In every analysis of pec 
lance performed, the treatments х levels or e = 
action component of the variance between gr - 
has been insignificant. Therefore, in light of Ae 
data collected under the conditions of this expe Б 
ment, the null hypothesis of zero interaction 
tenable. 


Discussion 
Seer: 


It was thought prior to the experiment ра 
directed discovery method would ђе тоге d de- 
tive with the brighter pupils and the direct an ple 
tailed method more effective with theless а ent 
Pupils. The complete absence in this exper apo 
of significant interaction between teaching me 
and mental ability was an unexpected result. f the 

Of considerable interest is the shape ont by 
curves depicting the retention of pupils арени = 
the directed discovery method. Even ata jn no 
SiX weeks after instruction, these cu r v es ое, 
indicate any appreciable loss of material € the 

The following finding has implications = not 
design of future research of this type. На sig- 
the difference scores method been employed; 


ігі Bye 
nificant differences in retention would ues SEDE 
been discovered, That is, by simply ana 2 oll 


retention data at опе week and again at Six was 
ПО difference in retention by treatment мар ре- 
found, However, by comparing the differen?" at 
tween scores made by individuals initially vere 
Опе and six weeks, significant differences 
ascertained, ry ар“ 
It would appear that the directeddiscove У gith 
proach to teaching and learning can be чбе sface- 
the pupil of low mental ability with most ва che 
tory results, qt has been held by many (ей! wi 
that careful direct and detailed presentation а 
numerous examples, followed by repetit slow 
drill, is an effective way of teaching the 
learner, dy аге 
Teaching methods с om pared in аи d 
rarely used in pure form. Good teaching cific 
use of selected approaches geared to ne are 
teaching Situations. The results of this Stu ar 
applicable to the extent that each method сот 
ed can be applied in practice in pure и and 
These findings Support some prior stu jment® 
are in conflict with results of other pem 
Previously noted. It would see m to the W 


TABLE V 


ANALYSIS OF 


ad 


Sum of Squares df 


VARIANCE OF LEARNING SCORES ON TRANSFER ONE WEEK TEST 


Mean Square F 


1 440.0 5.158* 


Treatments 440.0 

Levels 3, 362.5 2 

Treatments x Levels 86.1 2 

Within Sets 1,164.3 84 
89 


05 - 3.96 


* Significant Е at. Е 
05 = 3. 


жж Significant F at . 


TABLE VI 


SCORES ON TRANS 


ARNING 
ANALYSIS OF VARIANCE OF LE 


Sum of Squares 


1,681.3 19. 710** 


43.1 ә 


85.3 


FER SIX WEEKS TEST 


Source 
1 877.3 10.885* 
877.3 
Treatments à 2,448. 5 30. 318** 
1.0 
Levels a 2 8 - 
.6 
Treatments x Levels 84 80.6 
ар 6,768.0 
Within Sets ý 89 
Total ed 
gignificant F at a = en 
+ ofa ru wee Be Significant F аё. © 
gnificant Ка. 3.11 


і.05- 


ж к 
* Significant F а 
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that replication of experiments must be encour- 
aged to build up a body of knowledge regarding 
théory of teaching andlearning. In many instan- 
ces, particularly in graduate research in educa- 
tion, a taboo is placed upon the replication of pre- 
vious work. 


Summary and Conclusions 
Summary апе eee 


In summary the investigator found: 

1. With regard to initial learning, that there 
was no statistically significant difference in a- 
chievement between those Ss receiving Method A 
or Method B. 

2. With reference to retention, at one week, 
of material initially learned, thatthere was no 
statistically significant difference in retention be- 
tween Ss receiving Method A or Method B. 

3. With respect to retention of material ini- 
tially learned as determined six weeks after in- 
struction, that Ss taught by the directed discovery 
method retained a statistically significant greater 
proportion of this learning when com pared to Ss 
instructed by the direct and detailed method, 

4. In regard to effective application or trans- 
fer of learning as determined one week after in- 
struction, that there was a statistically signifi- 
cant difference in transfer, between Ss receiving 
Method A and Method B, in favor of the directed 
discovery group. 

5. In relation to transfer six weeks after in- 
struction, that Ss taught by the directed discovery 
method were more able to apply, to astatistically 
significant degree, the learning acquired when 
compared to application made by Ss given the di- 
rect and detailed treatment. 

6. In attempting todiscover differential effec- 
tiveness of direct and detailed and directed dis- 
covery teaching methods with the low, average, 
and high intellectual levels, that there was no ap- 
parent interaction between teaching method and 
intellectual level. 

The following conclusions seem warranted: 

1. The direct and detailed and the directed 
discovery methods of teaching are equally effec- 
tive with regard fo initial learning of micrometer 

inci nd skills. 
prins per and detailed and directed dis- 
ES methods of teaching are equally effective 
pes ference to retention of material initi ally 
with et as measured one week after instruction. 
я The directed discovery approach to teach- 
А га superior to direct and detailed instruction 

dmi ct to retention of materialintially 
with ж determined six weeks after instruction. 

4. The directed discovery method of teaching 
а Ў ffective than the direct and detailed ар- 
is more ё abling pupils to made wide applica- 
proach in n rial learned to new and related sit- 
и [*^ at one and six weeks after instruc- 


5. There is no interaction of teaching method 
and intellectual level. 
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ANALYSIS OF QUESTIONNAIRE RESPONSES 
BY CERTAIN PSYCHOLOGISTS* 


ANDREW L. COMREY 
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А PREVIOUS paper reported the results of a 
Survey of psychologists listed in the 1951 APA 
directory as being males, employed at colleges 
Or universities, and members of Phi Beta Kappa 
(1. The questions concerned work habits, per- 
Sonalcharacteristics, interests, preferences, 
and attitudes. About ninety percent of the question- 
naires were returned. Each question was statis- 
tically related by means of the epsilon coefficient 
to several internal questionnaire criteria: inter- 
est in administrative work in psychology, indus- 
trial consulting, counseling and guidance, psycho- 

егару, research, teaching, and publication rate. 
The last criterion measure was determinedas a 
ratio of the number of scientific articles and mon- 
°8raphs published to the years of full-time pro- 
fessional experience. 

The considerable number of significant rela- 
tionships discovered suggested that further anal- 
YSis might prove worthwhile. Accordingly, sixty 
of the most significant items were chosen to con- 
Stitute the variables for a factor analysis. А ran- 
Ош selection of 216 cases was taken for which 
Phi coefficients were computed between each of 
the 60 items and each other one. Each phi coef- 
ficient was divided by the maximum phi possible 
for the marginaltotals concerned. Since most of 
the items were multiple choice or completion 
tems, it was necessary to dichotomize each one 
artificially, This was done as near the median 
aS possible in each case. 
th Seventeen centroid factors were extracted from 

© matrix of phi over phi max coefficients. The 
VO highest loadings on the last factor were .22 
d - 21, respectively. No loading of .3or таа 
t curred after the ninth factor. The 17 centros 
actors were rotated analytically by Kaiser’s Var- 

пах method (2), This procedure tends to maxi- 
Mize the variance of the squared extended vector 
Projections, which usually yields an orthogonal 


imple st ion if опе exists in the 
data жж ructure solution 


Results 


Each factor will be presented with those vari- 


АП _ 
footnotes will be found at end of article. 


ables for which the loadings were . 3 or more. 
The factor number and proposed name will be fol- 
lowed by a figure in parentheses which gives the 
number of loadings between -.1 and .1 to indicate 
hyperplane density. After a brief statement about 
the factor, the item number and loadings will be 
given, opposite which will appear a description of 
the variable involved. Each variable is usually a 
dichotomized multiple choice or completion item, 
but only a question without the alternatives will be 
presented. It is understood that such question- 
naire responses as ‘‘yes,’’ ‘‘quite a bit,” and so 
on, are toward the positive side of the variable, 
despite the fact that the precise alternatives will 
not be given here. 

Factors I, УШ, and X were minor factors with 
only one or fewer loadings over. 4; hence no at- 
tempt will be made to interpret them. 

Il. Administrative Interest (35). The two items 
of major importance on this factor clearly identify 
it as being concerned with the individual’s desire 
to participate in administration. 


Description 

How much would you enjoy be- 
ing head of the psychology de- 
partment at a major university? 
Assuming you were qualified, 
how much would (do) you enjoy 
doing ad ministrative work in 
psychology ? 

How much do you enjoy work- 
ing on group projects ? 


Item Loading 
45 .56 


57 .55 


51 81 


Ш. Teaching Interest (40). Item 57 was one of 


the internal criteria analyzedinthe previous study 
and helped to define factor П. Item 62 also was 
such an internal criterion and represents an im- 
portant defining variable for this factor. 


Item Loading Description 

36 . 66 Would you object to a position, 
otherwise desirable, if you had 
no classes to teach? 

62 .60 Assuming you were qualified, 


how much would (do) you enjoy 


[4:14 
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doing teaching? 

How much would you like a 
well-paid teaching position in 
a small liberal arts college of 
good reputation in a small 
community ? 

Assuming you were qualified, 
how much would (do) you enjoy 
doing industrial consulting? 


43 . 36 


58 -.31 


IV. Moralistic Orientation (35). These items 
embody a rigid adherence to established values, 
particularly in the religious and sexual area. It 
is noteworthy that in this sample ‘‘importance of 
religion asa force in the individual's life" should 
besoclosely associated with intolerance of moral 
and philosophicaldeviates. Whether this would be 
true in a more representative sample of the gen- 
eral population would be difficult to say. 


Item Loading Description 


69 . 75 How much would you resent a 
colleague who was an atheist? 

72 .13 How much would you resent а 
homosexual? 

28 . 62 How much of a positive force 
is religion in your life? 

68 .56 How much would you resent а 
а colleague who was an adul- 
terer? 

70 .46 How much would you resent a 
colleague who was a member 
of the communist party ? 

32 =. 84 How would you describe your 


basic political philosophy (lib- 
eralism vs. conservatism)? 


у. Drive (41). The exact nature of this factor 
islessclearly outlined than is the case with some 
of the others, but the hypothesized identity seems 
reasonable. The title is intended to mean some- 
thing like energy level. 


Description 

How much difficulty do you have 
in writing papers, speeches, 
etc. ? 
In comparison with other men, 
how much interest in sex have 
you had during your life? | 
Are you at ease in Social situ- 
ations? | | 

37 Would you mind а job which re- 
| quired youto be at a particular 
place 40 hours per week? 
How much would you like а 
well-paid teaching position in 
a small liberal arts college of 
good reputationina small com- 
munity ? 


Item Loading 
54 -. 58 


34 ‚48 


30 . 46 


40 


43 =, 83 


VI. Seniority (38). These variables all fit well 
into the seniority category since each is related to 
length of service. 


Item Loading 
85 Age. 

3 .81 Years of full-time profession- 
al experience. 
About how many scientific ar- 
ticles and monographs have 
you published, or had accepted 
for publication? 
How much harder do you work 
than would be necessary to 
“get by” ? 


Description 


20 .54 


53 ‚32 


УП. Service Orientation (38). Psychologists 
are thought by the layman to be devoted to ‘‘help- 
ing people, ” but these results make it clear that 
variance exists among psychologists in the extent 
to which they are oriented in this particular di- 
rection. Itis interesting that neither counseling 
or psychotherapy interest proved to be the domin- 
ant variable on any factor but rather these two 
joined with teaching interest as somewhat lesser 
variables on this factor of broader character. 
This would tend to suggest that considerations 
other than the desire to help people are also im- 


portant in determining interest in counseling and 
psychotherapy. 


Item Loading 


Description 
67 m 


How much do you want to help 
people who need it ? 

How much do you want to do 
Something for society ? 

To what extent would you allow 
graduate students’ ex presse 
interests to determine the con- 
tent of a graduate course? 
Assuming you were qualified, 
how much would (do) you enjoy 
doing counseling and guidance 


65 . 62 


48 . 44 


59 . 41 


62 . 40 Assuming you were qualified, 


how much would (do) you епјоу 
doing teaching? 
60 235 Assuming you were qualified, 
how much would (do) you enjoy 
doing psychotherapy ? 
How much weight would you 
place on published research in 
evaluating the merit of а psy- 
chologist ? 


42 -.33 


IX. Resentment of Plagiarism (44). Probably 
something a bit broader than the title would sug- 
gest is involved here, but it is difficult to say pre 
cisely what its nature is. 
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Description 
How much would you resent a 
colleague who was a plagia- 
rist? 
How much would you resent a 
colleague who was a member 
of the communist party ? 
About how many evening hours, 
if any, do you spend on pro- 
fessional work in an average 
week? 


Item Loading 
21 ТО 


70 247 


ХІ. Research Productivity (27). Variable 74 
Which represented the ratio of number of publica- 
tions to years of professional service, here was 
2150 one of the internal criteria used in the pre- 
vious analysis. An interesting question which in- 
vites speculation is that of whether items 24 and 

„Гергеѕепі partial cause and effect relation- 
Ships with item 74, and, if so, which is cause 
and which is effect? 


Description 
Production rate (ratio of arti- 
cles to years of service). 
Assuming you were qualified, 
how much would (do) you enjoy 
doing research? | 
How muchof your profession- 
alcareer has been spent in 
positions where you were ex- 
pected to do research? 
Would you enjoy a job where 
40 hours per week werede- 
voted to teaching and prepar- 


ation? 


Are you n 
institution which 6 


Ph.D. in psychology? | 
About how many scientific ar- 
ticles and monog raphs have 
you published, or = accept- 
ed for publication 
How iem do you want to have 
national recognition as a psy- 
logist ? 
pes Munt influence do you 
expect your work to have on 
the developmentof psychology 
in the United States " 
7.43 Assuming you were qualified, 
how much would (do) you enjoy 
doing counseling and guidance 


en To how many profes р а! 
4 journals do yon sub E " 
4 How much weight wo y : 
place on published rese mn 
inevalu өлгі the merit о 
logist А си 
ч -.35 gem is ajor dier 
place too much emphasis 


Item Loadi 


61 . 66 


25 ‚61 


37 .58 


now employed by an 


24 
. 54 rants the 


0 а 


63 ‚55 


at . 43 
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research? 

How much emphasis should be 
placed on research methods in 
training clinical psycholo- 
gists? 

How much would you like а 
well-paid teaching position in 
a small liberal arts college of 
good reputation ina small com- 
munity ? 

12 . 33 About what annual income do 
you expect to reach? 

About what percentage of psy- 
chologists measure up to your 
standards as to what a psychol- 
ogist should be? 


35 . 33 


43 -.33 


14 -. 30 


XII. Com petitive Personnel Policy (37). The 
individual high on this factor is likely io feel that 
some psychologists are better than others and 
should be rewarded forit. He is also more active 
in attending professional gatherings. 


Description 
Should an out standing man be 
promoted sooner than he other- 
wise would be if he received a 
better offer somewhere else? 
About what percentage of psy- 
chologists measure up to your 
standards as to what a psy- 
chologist should be? 
How many regional and nation- 
al psychology meetings did you 
attend in1950, 1951, and 1952? 


Item Loading 
21 .48 


14 -.40 


ХШ. Entertaining (45). That item 18 should 
have a negative loading and item 16 a positive one 
seems reasonable in view of the fact that one can- 
not be two places at the same time. On the other 
hand, one would think that frequent home enter- 
taining might call for frequent social ventures be- 
yond the threshold too. Perhaps item 18 was in- 
terpreted by the respondents more in terms of 


public places of amusement. 


Description 
About how many evenings in an 
average month do you enter- 
tain friends in your home? 
About how many evenings in an 
average month do you go away 
from home for an evening's 
entertainment ? 
How much do you read for rec- 
reational purposes 2 


Item Loading 
16 . 67 


18 -. 48 


45 . 30 


XIV. Materialistic Orientation (44). In one 
way or another, eachitem inthis group has some- 
think to do with activities or events likely to en- 
hance the financial position. Thus, the factor 
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seems to be concerned with the extent to which 
great value is placed on money. 


Description 
Could you be interested in a 
business career ifa really 
good opportunity came along? 
If you were to receive a large 
inheritance, would you give up 
your job? 
How muchdo you want to have 
quite a bit of money 7 
Assuming you were qualified, 
how much would (do) you enjoy 
doing industrial consulting? 
Would youlike to direct a re- 
search project involving a 
staff of 100 people or more? 


Item Loading 
23 . 62 


31 .48 


66 .4T 
58 . 9T 


41 . 36 


XV. Hedonism (42). These items seem to 
characterize thehighly verbal, fun-loving scholar 
who refuses to take himself or psychology very 
seriously. He feels that his duty is to enjoy life 
for himself and also for those other psychologists 
who are so busy or preoccupied that they haven't 
time to do so, or perhaps don't know how. 


Item Loading Description 


50 .47 How much time do you spend 
in **socializing" during work- 
ing hours? 

44 . 44 How much do you like biblio- 
graphic work? 

45 . 41 How much до you read for rec- 
reational purposes? 

53 -.40 How much harder do you work 


than would be necessary to 
“get ру”? 


XVI. Introversion (35). Two ofthese items 
place great importance оп research and research 
training while the other finds being alone not un- 

leasant. The mostobvious common denominator 
а these responses appears to ђе а type of self- 
contained, as opposed to peo ple-oriented, per- 


sonality. 


i Description 

m a dm How much emphasis should be 
35 4 placed on res earch methods 
in training clinical psycholo- 

gists? 
40 How much weight would you 
= ` place on published research 
inevaluating the merit of a 

psychologist ? 

-, 38 Do you find it unpleasant to be 

= ` а1опе? 
хуп. Collectivism (45). Many individuals in 


hology emphasize harmonious mer ging into 
psycho 


the team where each Cooperative personis accept- 
ed and there is a minimum emphasis on personal 
evaluation. Self-seeking by energetic and ambi- 
tious group members is frownedupon as contrary 
togroupgoals. Cooperation replaces competition. 
The items loading on this factor appear to define 
Such a general point of view. 


Item Loading Description 


32 ‚41 How would y ou describe your 
basic philosophy (liberal vs. 
conservative) ? 

38 . 44 Do you believe that life in our 
Society is too competitive? 

5 -.40 To how many professional 
journals do you subscribe? 

69 -.39 How much would you resent a 
colleague who was an atheist? 

T -. 34 How many regional and nation- 
al psychology meetings did you 
attend in 1950, 1951, 1952? 
Discussion 


Several of the criteria selected for analysis in 
the original published study emergedhere as inde- 
pendent factors. Administration and teaching in- 
terest variables defined two fa ctors individually 
While research interest and publication rate de- 
fined a third. Interest in industrial consulting 
failed to define а factor itself but had a substan- 
tial loading on Materialistic Orientation. The two 
remaining criteria, interest in psychotherapy and 
interest in counseling and guidance, showed up to- 
gether on the Service Orientation factor, although 
with lower loadings than one might expect. Other 
variables not Originally conceived as criterion 


tion. Tes Proved to be important in factor defini- 
п. 


these psychologists differ are: interest in admin- 


3 › interest in teaching, moralistic orien- 
tation, Seniority, desire to help others, research 
productivity, and materialistic orientation. It is 
interesting that each and every one of these fac- 
tors represents an area frequently involved in 
personnel action and policy decisions. Tt is 2150 
noteworthy that these factors should 


have emerged from the а; i 
lica: ntirely 
analytic rotation сене Баны 


Summary 
LY 


А factor analysis w 
Írom a questi. 
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Írom the matrix of phi over phi max coefficients. 

Analytic rotations were carried out using Kaiser's 

Varimax method. Factors of sufficient importance 

Маша naming were: лота алтау WHT, 
b ‘interest, Moralistic Orientation, Drive, 
Seniority, Service Orientation, Resentment of 
Plagiarism, Dislike for Mathematics, Research 
Productivity, Competitive Personnel Policy, En- 
tertaining, Materialistic Orientation, Hedonism, 
and Collectivism. 


FOOTNOTES 


* This study was made possible primarily be- 
cause of the availability of SWAC, ап electron- 
ic computer operated by Numerical Analysis 
Research of the University of California, Los 
Angeles, and supported by the Office of Naval 
Research, The opinions expressed are the au- 
thor's, Further financial support for this work 
сате from a research grant by the University 
of California. 


**The tables of correlation coefficients, centroid 
loadings, and rotatedloadings have been depos- 


ited withthe American Documentation Institute. 
Order Document No. 4858 from the ADI Auxili- 
ary Publications Project, Photoduplication Ser- 


ies, Library of Congress, Washington 25, D. 
о 55,5% 55055 Ші. 
crojilm ог for 6x8 in. photocopies 
readable without optical aid. Make check pay- 
able to Chief, Photoduplication Service, Library 
Of Congress, A сору of the complete question- 


nairetogether with the response frequencies 
also has been deposited. 
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Introduction 
—_ 


м STUDY seeks to determine limited apti- 
te * Characteristics of students ina short missile 
aft nician's course, and the general relationship 
of hese aptitude characteristics to various parts 
the course and the final course average. The 
iun Onnel Research Branch (PRB) of the Adju- 
General’s Office, Department of the Army, 
45 put forth much effort to stabilize and stand- 
Hu ize measures of aptitude characteristics. 
ioe has been concerned with training prob- 
mu the assessment and improvem ent of 
ent 16 circumstances. The purpose of the pres- 
піве 19У is to assess academic achievement 9 
daro tec hnicians in terms of their aptitude 
or у "teristics, and suggest concrete referents 
further training research in this area. 
The ten aptitude tests in the present Army 


fe t8sification Battery (ACB), which are adminis- 
ед to most enlisted personnel when they бы 
іпсе 


5 
that e became operational in 1949 (10). 
alyz ime, PRB has continually reviewed and an- 
Sur ed these measures (e. g. , 2, 3, 10, 11) to en- 
ien their stability and enhance their usefulness 
rmp edictive measures of success in various 
is У °CCUpational specialities. Though research 
өңір 5Sently programmed for the ACB in the mis- 
field, such information is not now available. 
Search major interest in Hum RRO's training в 
ent à has resided in comparing course achiev 
empl with later proficiency in the field. An ex- 
rd Study (9) determined the major opera- 


tio 
ha] fuper erson- 
net Ре aintenance р 
пе lons for missile m to meas- 


> Duilt ici itten tests 
Ur | t proficiency and wri 
ote, ity regarding t hese functions, and S 
Пеја "Cent school graduates with experienc 


as у personnel on the written and proficiency de 
of Шу 4S several other variables. The eae 
а Wo major groups (і. е., the Бі меге 


ates 
not „d the field -experienced Рт АСВ 
st o 


Score, Pared with regard to most 
Aptitude measures in this study i 


ris А 
Ро ed of ore (i. e. З 
ч an electronic SC leet omit 


п 
Ч of two ACB scores) and the E 
* 


1 " 
footnotes will be found at end of article. 


Placement Testl; aptitude, as measured by these 
variables, correlated to some extent with written 
test scores but demonstrated very little relation- 
ship with the proficiency test scores. Now, itis 
not reasonable that aptitude should be unrelated to 
proficiency (i.e., ability); therefore, a more ex- 
tensive study of aptitude characteristics of such 
groups might well prove rewarding from both the 
situational and measurement standpoint. 

Another HumRRO study (1) investigatedthe re- 
lationship of academic achievement in various 
parts of a course. But again, no extensive use 
was made of aptitude as related to the various 


parts of the course. 


Method 


The Course— The course under investigation 
was a five and one-half week technician course 
conducted at the U. S. Army Air Defense School, 
Ft. Bliss, Texas. The 220 hours inthe course 
were used as follows: 1) 21 hours for Missile Me- 
chanic (MM) training; 2) 34 hours for Launcher 
Area (LA) training; 3) 85 hours for Missile Prep- 
aration and Depreparation (MPD) training; 4) 80 
hours for non-academic functions, distributed 
variously throughout the course (e. g., incoming 
and outgoing processing time, physical training, 
etc.) The course is, ess entially, a transition- 
type course following a much longer technician 
course. 

A written examination was given after each of 
the three main parts (i.e., іп this order, ММ, 
LA, and MPD) of the course. А total course av- 
erage (TCA) is computed by weighting the first 
two parts of the course one each, and assigning a 
weight of twotothe last, longer part of the course. 
There were four classes, including a total of 119 
enlisted trainees, for whom complete data were 
available. 

The АСВ Tests- Eight of the ten ACBtest scores 
were available for the 119 trainees as follows: 


Reading and Vocabulary (RV) 
Arithmetic Reasoning (AR) 
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Pattern Analysis (PA) 
Mechanical Aptitude (MA) 
Army Clerical Speed (ACS) 
Shop Mechanics (SM) 
Automotive Information (АТ) 
Electronic Information (EI) 


The remaining two ACB tests (i.e., Army Radio 
Code Aptitude and RadioInformation) were not in- 
cluded inthe analysis because of scoring difficul- 
ties and lack of data. A complete description of 
these variables can be found in a previous publi- 
cation (3) and in various other PRB studies. 

The Analysis— The eight ACB test scores and 
the four course scores, including the TCA, were 
intercorrelated for each class se parately, and 
the correlations combined by a weighted average 
using Fisher's z-transformations (e. g., 6:325-6). 
The resulting correlations between the ACB 
Scores were factored by the centroid method, and 
the centroid factors were rotated graphically. 
The four course scores were then projected onto 
the rotated factor structure. 


Results 


The intercorrelations among the eight vari- 
ables are presented in the lower half of the cen- 
tral portion of Table I, while the upper half con- 
tains the residuals after the extraction of two fac- 
tors. The right-hand portion of Table I presents 
the correlations of eachofthe four course scores 
with each of the eight ACB variables. The means 
and standard deviations for the eight ACB vari- 
ables are presentedalso appropriately to the left 
of Table I. 

The Factor Analysis— The 8 x 8 intercorrela- 
tion matrix in Table I was factored by the cen- 
troid method, the communalities being estimated 
as the highest correlation in each column, re- 
spectively. Actually, four factors were extracted 
in a preliminary analysis, but graphic rotations 
on the Zimmerman apparatus failed to produce 
anything on the third and fourth factors. Conse- 
quently, only the firsttwo centroids were used in 

the final analysis; these factors are presented in 
Table П. The reader will note that the first cen- 
troid has projected variances equalto 3. 4420; the 
second centroid, . 7742. The total variance, us- 
ing communalities in the diagonals, is equal to 
4.8000. The two centroids, therefore, account 
for approximately 85 percent of the variance in 

em. 
i 6 centroid vectors were rotated graph- 
ically through a clockwise angle of 419 30'. The 
rotated loadings are presented in Table III. 

The first factor is a Technical factor deter- 
mined, for the most part, by MA (. 718), SM 
(.751), AI (. 614), and EI (. 768); RV and PA also 
have fairly high loadings оп this factor, suggest- 
ing some reading and spatial characteristics in 


the Technical factor. The second factor is an Ac- 
ademic factor with RV (. 596), AR (. 753), PA 
(. 612), and ACS (. 513); MA and SM also have ap- 
preciable loadings on this factor, indicating some 
technical aspects of the factor. 

The ACB and the Course Tests— The four 
course tests were projected onto the rotated fac- 
tor structure (5:209-19), and the resulting load- 
ings are presented in Table IV. The second test, 
LA, and the final course average, TCA, have 
greater loadings on the Technical factor than on 
the Academic factor. The reverse is true for the 
first test, MN; it has more relation to the Aca- 
demic factor than to the Technical factor. The 
third test in the course, MPD, which represents 
the greater amount of instructional time and 15 
given the most weight in the computation of the 
final course average, does not seem to have much 
in common withthe system, but most of the attend- 
ing communality is located on the Technical fac- 
tor. Several inferences are available from this 
analysis, as will be presented in the Discussion 
section. 


Discussion 


The ACB Scores— The results ofthe factor an- 
alysis indicate that aptitude characteristics of 
missile technician trainees with respect to the 
ACB tests are of two major, distinct types, VIZ- » 
academic and technical. This outcome supports 
the methodology used severaltimes in possum, 
HumRRO research (9), theuse of both written an 
practical tests as measures of proficiency. The 
use of both types of tests may be required to taP 
both types of aptitudes and abilities of which the 
technicians show definite capabilities. The result 
also lends support to the U. S. Army Air Defense 
School's policy of using written and practical ex- 
aminations in most of their courses for techni- 
cians; logically it would Seem that, if both type? 
of examinations are given, success on practica 
examinations will be relatedto technical aptitudes 
while success onthe written examinations will de- 
pend to some extent on both types of aptitudes: 
Hence, a student's exhibition of content ab s o rTP? 
tion throughout the technical courses in the U- h- 
Army Air Defense School will depend on his tec ü 
nical aptitudes and, to a more limited extent, ay 
his academic-type aptitudes. This is not to si- 
that a given course should be built towards ар и 
tude characteristics of the students, but only Ба 
the measurement of learningthroughout any count 
Should take into account the goals of the cours е 
the nature of the program, and the post-gradua 
demands that willbe placedon the trainees. of 
ther studies regarding aptitude characteristics 
Successful field-experienced technicians sho" a 
indicate the propriety of measurement characte” 
istics in the School’s testing program. - 

The above discussion and the dichotomy of аР 


ТАВЉЕ 1 


INTERCORRELATIONS, RESIDUALS, MEANS, AND STANDARD DEVIATION 


S OF THE ARMY CLASSIFICATION BATTERY 
TESTS, AND THE CORRELATIONS OF THESE TESTS WIT 


H THE COURSE VARIABLES* 


Standard 
Deviations Tests Course Variables 
RV AR PA MA ACS SM AI EI MM LA MPD TCA 
. 063 -.113 -.017 -.040 -.017 .035 -. 026 .460 .401 .118 . 404 
.571 . 037 . 017 -. 065 . 057 -. 025 -. 043 . 471 . 342 . 084 . 343 
. 402 .558 . 001 . 019 -. 003 -. 064 . 033 . 408 . 318 -137 . 366 
.519 . 378 .511 -. 032 -.007 .008 -. 039 | .304 . 459 . 087 . 343 
ACS . 305 . 336 . 372 . 299 -. 097 . 075 . 055 . 203 . 145 . 035 . 164 
.503 . 306 . 497 . 656 . 341 -. 072 . 029 . 233 . 392 - 256 . 408 
.255 . 187 . 358 . 483 . 033 . 418 -. 025 . 251 . 402 . 164 . 405 
. 401 . 259 . 347 . 562 . 090 . 648 . 459 . 355 . 287 . 199 . 396 
*Тһе intercorrelations among the АСВ tests are presented in the lower half of the 8 x 8 matrix; the residuals after two factors 


› in the upper half, 
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TABLE II 


CENTROID FACTOR LOADINGS 


ACS Factor 
Tests I II h? 
RV . 684 .190 .504 
AR 614 . 462 590 
РА . 698 . 199 . 527 
МА 788 -. 193 653 
ACS .416 „817 . 274 
5М 780 -. 251 671 
АТ 519 -. 340 . 385 
EI · 662 -. 411 . 607 
ECCL."  —.)POáÓ Mg 

Sums of 
Squares 3. 442 . 774 

TABLE III 


ROTATED FACTOR LOADINGS 


ACB Factor 

Tests II h? 
RV 386 . 996 .504 
AR 154 . 753 .591 
PA 391 . 612 .527 
МА 718 · 378 . 658 
ACS 102 .513 ‚214 
SM 151 - 329 . 672 
AI 614 089 .385 
EI 768 131 . 607 
Sums of 


Squares 2. 382 1. 836 
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TABLE IV 


PROJECTED FACTOR LOADINGS OF THE FOUR COURSE 
VARIABLES ON THE ROTATED FACTOR STRUCTURE 


Course I II 
Variables Technical Academic h? 
MM . 251 . 498 ‚811 
LA .431 .314 .284 
MPD .237 . 045 . 058 
ТСА . 447 . 312 . 297 
TABLE V 


PRINCIPAL COMPONENT LOADINGS WITH COMPUTED 
CENTROID COMMUNALITIES IN THE 
PRINCIPAL DIAGONAL 


Factor 


tests “Гг” П hë 

py 2705 ‚212 ‚542 
АН ‚610 . 472 ‚595 
ВА . 112 . 232 ‚561 
M ‚189 -. 154 . 646 
ACS 2407 ‚341 ‚286 
ам 2801 -. 220 . 690 
" 517 -. 332 ‚378 
gt ‚613 -.408 . 619 
Sama 3.526 2791 


Squares 
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titudes among missile technicians suggest an- 
other interesting inference. Proficiency differ- 
ences in various areas of missile technology may 
be due to extreme emphasis on one or the other 
aptitudes. Theability to read schematic diagrams, 
for instance, is probably more closely related to 
academic aptitude while replacing a malfunction- 
ing component in a given missile system is prob- 
ably more closely related to technical aptitude. 
Differential performances in these two activities 
might well be attributable to differences in apti- 
tude characteristics de mo nstrable with the ACB 
variables. A more thorough study of aptitude 
characteristics with regard to proficiency would 
probably repay further research in any case; 
most certainly, such research would clarify the 
nature of post-graduation job demands that willbe 
required of missile technician trainees. 

The sample of technician trainees seems well 
above average onalleight aptitude measures used 
inthisstudy. The means and standard deviations 
obtained on a larger, random sample of enlisted 
men were presented in a previous study (10:4): 


Standard 
Test Mean Deviation 
RV 99.4 23.3 
AR 94.7 22.5 
РА 99.6 24. 1 
МА 102.5 19.5 
АС5 88.6 20.3 
SM 100. 7 20.7 
AI 99.8 20.1 
EI 100.5 18.5 


An examination of similar data to the left of Table 
Ireveals that the missile technician trainees not 
only score higher, on the average, thanthe gen- 
eral population of enlisted men, but they also tend 
to vary less about the mean than the general pop- 
ulation of enlisted men. Allin all, the missile 
technician trainees seem to be above average in 
every respect with regard to aptitudes. 

There is in the results of the present study an 
interesting anomaly as compared to previous 
classifications of ACB tests. | A pre vious study 
(11:19) refers to the Mechanical Aptitude test as 
a measure of * general aptitude," while the Army 
Clerical Speed test is referred to as '*.. . а more 
specific measure peculiar to the job family. a5" 

р wise, our Academic factor contains the gen- 
other casures and the Technical factor contains 
= e specific measures. True, MA shows 
the mor reciable relation to the Academic factor 
some ыы sa relatively small part in determining 
but it p n of this vector; moreover, the contri- 
асе АСЯ to the Technical factor is negligible. 
bution O tly, the academic and technical aptitude 
Apparen rca of missile technicians are suffi- 
characteris to locate each of these two tests 

jently disparate al nat The MA 
- others of their more general nature. e 
wi 


variable is more closely associated with technical 
aptitude while the ACS variable has more relation- 
ship to general, academic aptitude. As was noted 
previously, however, the missile technician train- 
ees are above average on both variables as well as 
all the rest of the ACV variables used inthis study. 

Aptitude and the Course Variables—Two of the 
course variables, LA and TCA, each show about 
twice as much relationship2 to the Technical fac- 
tor ascomparedtothe Academic factor. This re- 
sult appears to be most reasonable. Surely, 2 
technical training program can be expected to ex- 
ploit the technical talents of its trainees within 
some amount of academic framework, but it would 
seem that technical aptitudes should be the most 
important factor in determining a student's suc- 
cess or failure. Fromthis standpoint, it is en- 
couraging that the total course average, which in- 
dicates the student'soverallstanding, and, in this 
instance, is made up entirely of written test 
Scores, is determined for the most part by techni- 
aptitudes rather than academic aptitudes, though 
the latter receives ample consideration. 

Missile Mechanics is the only course variable 
more closely associated with academic-type apti- 
tudes than with those aptitudes associated with 
technical prowess. An explanation of this result 
might reside in the fact that MM is the first por- 
tion of the course when students are becoming ac- 
quainted with new material; in this circumstance, 
academic aptitudes might have a larger play in test 
Scores than technicalaptitudes. Ifthis is the сазе, 
similar results should be obtainable in research 
with ACBscores andothertechnical courses. Fur- 
ther studies, of course, might show other reasons 
for the behavior of MM in this study, but it is not 
immediately obvious why MM demonstrates about 
four times as much relationshipto academic, gen- 
eralaptitudes than to technicalaptitudes. Further 
research here should prove quite fruitful. 

From an inspection of Table IV it seems note- 
worthy that with the exception of MPD, the factor 
Structure generated by the eight ACB aptitude vari- 
ables accounts for about 30 percent of each of the 
course variable's variance. The lack of relation- 
Ship drawn between the aptitudes and MPD most 
certainly bearscloser scrutiny. Missile Prepar- 
ation and Depreparation consumes more than Ва! 
of the instructional time, and receives as much 
weight in the TCA as both MM and LA together- 
Still, notwithstanding the importance of the MPD; 
this study has told us relatively little about the un- 
derlying aptitude characteristics associated with 
this variable. Almost all of MPD’s communality 
is located on the Technical factor, but a mor? 
thorough study of this variable should be under- 
taken in future training research to better unde?” 
stand its nature. 

Though the ACBtests proved quite useful in the 
present study, it should be noted that none of thes" 
variables correlated with school grades as well ? 
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did the Electronic Placement Test ina previous 
HumRRO study (1). This result suggests that lo- 
cally developed tests might well be more closely 
associated with success in various technical train- 
Ing courses. Certa inly, more research should 
be conducted to combine army-wide aptitude tests 
with locally built tests in an effort to obtain a bet- 
ter understanding of aptitude characteristics as 
related to course achievement and job profi- 
ciency. 

Methodology—Some remarks regarding the 
methodology in the present study and that in future 
training research seem to be in order. 

Questions regarding the relationships of two 
Sets of variates often arise in training research. 
We can, of course, canonically correlate the two 
Sets of data and develop the most predictable cri- 

erion. Very often, howe ver, as in the present 
Study, we are interested in a parsimonious de- 
Scription of one set of variables, and each of a 
Second set of variable's relation to the first set. 
The method of factoring the first set of variables 
and Projecting the second set, only makes the re- 
Sulting Structure seem to be a convenient approach 
in explaining such relationships in the data. у 
Problems in volving differential prediction, 
Wwe probably cannot do better than distance func- 
‘ons and canonical variates, or perhaps the use 
of some derived measure such as centour scores 
ex elated to Mahalanobis’ D? statistic. But for 
osploratory Studies, such as the present one, the 
simum properties of a principal component-type 
lution do not necessarily provide a clear pic- 
d Kendall (7:28) purports that methods such 
а the centroid technique “... are objectionable 
"id should not be used when they can be avoided A 
Ше know from Danford's work, for instance, 
е the centroid, simple summation technique, 
апа ding оп reflections, bears more relation to 
еј 518 Of variance than the principal component, 
o Shted Summation method. Moreover, it seems 
Mena Advantageous in exploratory studies to sep- 
» e Variables as much as possible in the factor 
есе апа іё арреагѕ сопуе nient to accomplish 

Consult via rotated factor solutions. у 
by Stain results, of course, сап be supporte 
Principal component solutions. A principal 

Ponent analysis of the 8 X 8 intercorrelation 
fro rix in Table I, using communalities computed 
е centroid solution, produced the ше. 
Зое ted in Table У. Again, as in the centroi 
Count on, the first two components together a 
ance for approximately 90 percent of the vari 
loadin еге, the first component reflects high 
Com 8S for all eight ACB tests, while the seco " 
Чар nent reveals а separation of variables eo 
bout у, АЕ in the rotated centroid solution. si 


со Регсепі of the variance in the princip Е 

feren ent Solution, however, allows for this О 

Сеј ation among th riables. The rotate 
troi е ЗА to provide а 


Solution. then, appears 


со 


Present 


greater differentiation among the variables in 
terms of their variances. 

One other problem isthat the 8 x 8 intercorre- 
lation matrix was built by averaging 4 matrices of 
similar correlations. The present writers know 
of no proof that such a matrix will be Gramian. 
The requirement ofa Gramian matrix, in any case, 
will carry less import in the centroid technique 
than in a principal component-type analysis. 


Summary 


Course grades in a short missile technician's 
course were studied in relation to aptitude char- 
acteristics as reflected in eight Army Classifica- 
tion Battery tests. There were four classes, in- 
cluding a total of 119 enlisted trainees, for whom 
complete data were available. 

The Army Classification Battery tests were 
factored by the centroid method. Two centroid 
factors were extracted and rotated graphically. 
The first factor was determined to be a Technical 
factor composed of the following tests: Electronic 
Information, Shop Mechanics, Mechanical Apti- 
tude, and Automotive Information. The second 
factor was defined as an Academic factor charac- 
terized by Arithmetic Reasoning, Pattern Analysis, 
Reading and Vocabulary, and Army Clerical Speed. 

Four written test score distributions were in- 
volved in the missile course: one test after each 
of three parts of the course, and a combination of 
all three tests to form a total course average. 
Each of the four distributions were projected sep- 
arately onto the factorial structure determined by 
the aptitude variables. The first test covered 
Missile Mechanic training and was more closely 
associated with the Academic factor than with the 
Technicalfactor. The second test in the course, 
covering Launcher Area training, and the total 
course average proved to have twice as much 
identification with the Technical factor as with the 
Academic factor. The third test, Missile Prepar- 
ation, had very little relationto the system of apti- 
tude tests; the attending communality was located, 
however, onthe Technicalfactor. Suggestions 
were given for further training research with the 
Army Classification Battery tests. 

The method of the present study was discussed 
in relation to future training research. The cen- 
troid methodoffactor analysis, and the projection 
of variables onto the resulting factorial structure, 
was suggested for further ex ploratory studies in 


the area of training. 


FOOTNOTES 


* Permission is granted for reproduction, trans- 
lation, publication, use and disposal in whole 
and in part byorfor the United States Govern- 
ment. Theopinions expressed are solely those 


298 JOURNAL OF EXPERIMENTAL EDUCATION 


of the authors and are in no way official; nor 
are they to be construed as representing those 
of HumRRO or any other bureau or agency. 

. 


** The authors wish to express their appreciation 
to Mrs. Lynne Von Kanelforher most valuable 
assistance in the computations involved in the 
present study. 

Present address of Dr. Anderson: American 
Institute for Research, 11607 Washington Place 
Los Angeles 6, California. 


1. This test was built by personnel іп the U. S. 
Army Air Defense School, Fort Bliss, Texas. 


2. “Relationship” herein refers to the square of 
the obtained factor loadings, which indicate di- 
rectly the proportion of variance involved. 
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ESTABLISHING CRITERION GROUPS FOR 
EVALUATING MEASURES OF CURIOSITY 


WALLACE Н. MAW 
University of Delaware 
ETHEL W. MAW 
Bryn Mawr College 


CURIOSITY HAS long been considered an im- 
Portant attribute, if not always one to be encour- 
aged (4). In recent years it has received in- 
creasing attention because of its relationship to 
Creativity. Most schools of psychology implicit- 
у ог explicitly indicate an awareness of it (2,7). 
Curiosity or exploratory behavior of lower animals 
has been rigorously investigated (3, 6), and some 
effort has also been made to study curiosity of 

uman beings (1). 

Although a considerable body of literature has 
accumulated in which curiosity has been discussed, 
very few em pirical studies have been directly 
Concerned with children’s curiosity. One reason 
Or the dearthof investigations involving children 
тау be the lack of instruments with which to 
Measure curiosity. 

Cur; major problem in developing measures of 
is ону is establishing validity. One approach 

to identify a group of children of high curiosity 
wh another group of low curiosity and to see 
ings Proposed measures of curiosity discrim- 
вме betweenthetwo groups. Isolating such cri- 
exer Sroups was the purpose of the present in- 

igation. 


S Л TS 
Securing Judgments of Children’s Curiosity 


term was first necessary to define curiosity in 
made. Of behavior. To do this, many statements 
Out luy philosophers and psychologists through- 
Чван Story as well as reports of empirical inves- 
еа саа were analyzed. The analysis 15 report- 
s Where, ** ра 

elen а result, for the purposes of this study, а 
osi у агу school child was said to exhibit curi- 
У to the extent that he: 
` Teacts positively to new, strange, incongru- 
915, ог mysterious elements in his envi- 
ronment by moving toward them, by explor- 

2, (ПЕ them or by manipulating them, 

` €xhibits a need or a desire to know more 


* 
Foo 
tnotes will be found at end of article. 


about himself and/or his environment, 

3. scans his surroundings seeking new exper- 

iences, 

4. persists in examining and exploring stimuli 

in order to know more about them. 

The teachers of five fifth-grade classes were 
asked to judge the curiosity of their pupils in light 
of this definition. Atthe same time, the pupils 
were asked to judge their peers and themselves. 
Thus three judgments ofthe curiosity of the chil- 
dren of each class were secured—teacher -judg- 
ment, peer-judgment, and self-judgment. 

Efforts were made to minimize errors inher- 
ent in this approach. The evaluative instruments 
were administered to all classes by one person 
who used the same procedure in each case. Each 
class was observed by an independent observer 
one hour per week for ten weeks. The cumula- 
tive record of each child was reviewed and ser- 
ious discrepancies between the record and the 
judgments of the evaluators were studied on an 
individual basis. 

Three instruments were developed for the dif- 
ferent types of judgments. Each instrument was 
constructed to include all aspects ofthe operation- 
al definition. In addition, the instruments used 
by children were either carefully controlled in 
terms of vocabulary or were read to them. 

Each teacher was given the definition of curi- 
osity together with an example for each part of 
the definition. She was told that all of the kinds 
of behavior included might not be observable in 
any one child, but that it was reasonable to sup- 
pose that the more of them a child showed, the 
more curious he was. The teacher was also 
cautioned that the child who showed the most cur- 
iosity might not be the one who was making the 
best classroom adjustment. 

Each teacher was asked to rate her pupils in 
the following manner: 

1. Write the name of the child you consider to 
have the most curiosity on the first line. 
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2. Write the name of the child you consider to 
have the least curiosity on the line corresponding 
to the number of pupils in your class. 

3. Next, write the name of the child you would 
rank second in curiosity on line two. 

4. Then write the name of the child you con- 
sider to have next to the least curiosity on the 
line above the name of the child having the least 

curiosity. 

5. Continue ranking in this manner until you 
have ranked all of the children in your class. 


Since this method appeared to be too compli- 
cated for the majority of the children to use to 
evaluate their peers, a Who-Should-Play-the- 
Parttest was created. The children were given 
the description of eight roles—four of children 
whose behavior exhibited much curiosity and four 
whose behavior exhibited little or none. They 
were told to select children in their classrooms 
who were generally most like the characters re- 
quired for the play. 

Typical role descriptions are the following: 


Part 1. This part will be played by a class- 
mate who keeps working for a long time trying to 
understand anything new which can be examined. 
This pupil sticks to problems t rying to solve 
them. This member of the class is the last to 
give up when the class is looking for answers to 
questions. This pupil keeps asking questions af- 
ter everyone else has stopped and will remain 
working on strange things after others are done. 
This child often takes things apart, but will work 
a long time to put them together to find out how 
they work. 

Part 8. This part will be played by a pupil who 
misses seeing the things that other members of 
the class seeeasily. This pupil is not easily dis- 
turbed by things that happen in the classroom. 
When something new or strange is brought into 
the classroom, this classmate often does not look 
at it or just gives it a slight glance. 


The pupils were asked to evaluate themselves 
using an instrument consisting of 41 statements 
regarding habits and attitudes and entitled ** About 
Myself.” They were told that there were по 
right" or **wrong" answers, that the best an- 
swer was what they thought was trueof themselves. 
Although the majority of the items were stated in 
terms of behavior that logically indicated curios- 
ity, some statements were used that implied just 
the opposite. Eachofthe items was related to 
one or more points of the operational definition. 

The following aretypicalitems from the About 
Myself test: 


Whenthere is something new in the room, I notice 
it right away. 


Never Sometimes 
Often ^ Always 

Ilike to discover new things. 
Never Sometimes 
Often Always 

I keep away from strange and unusual things. 
Never Sometimes 
Often Always 


When I see a strange machine, I go up to it and 
look at it. 

Never Sometimes 

Often Always 


All of the judgments of curiosity were made 
during the first week of March after the teachers 
and classes had been working together for at least 
six months. Inone classroom the teacher and 
pupils had been together for sixteen months. 


Selecting Groups of High- and Low- 


Curiosity Children 


It was anticipated that certain factors—age, 
race, popularity, sex, and intelligence might 
have some effect on the judgment of the evaluators. 

Age was kept within narrowlimits by restrict- 
ingthe study to one grade in school. The fiíth 
grade was selected to lessen reading problems 
and to secure children whose interests were less 
canalized than those of adolescents. 

Atthe beginning of the study, the pupils’ ages 
ranged from ten years, two months to twelve 
years, eight months. Their Lorge-Thorndike in- 
telligence quotients ranged from 71 to 139. 

Of the 158 children, thirteen were Negroes— 
twogirlsandelevenboys. Thequestion was raise 
regarding the extent to which racial bias might in- 
fluence judgments made by the teachers or the [xa 
Pils. In one room there was one Negro. In eac 
of the two other rooms there were six Negroee. 
In one of these, the teacher and the pupils Dry 
the same three children in the upper half of 5 e 
class and the other three in the lower half. In ae 
other room, the teacher placed five of the pou 
Чгеп in the upper half while the peers judged 10 ct 
to be in the lower half. By using Fisher's EX?" 
Probability Test, it was determined that this У 
not significant at the .05 level and therefore shou 
be considered a chance arrangement. er 

Another question to be answered was whet s 
the substantial agreement found between the JU Ка 
ment of teachers and pupils could be accounted 
by popularity. In other words, did teachers ену 
peers tend to rate popular pupils high іп curiosit? 
and less popular pupils less high? In order to pio 
termine the popularity of the children, the O pe 
Social Acceptance Scale was administered. T 
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TABLE I 


AGREEMENT BETWEEN TEACHERS AND PEERS IN RANKING PUPILS 
IN FIVE CLASSROOMS AS TO THE EXTENT TO WHICH THEY 
EXHIBIT CURIOSITY WITH THE EFFECT OF POPULARITY 

PARTIALLED OUT 


Level of Partial 
Room N Tau Significance Tau 
A 31 “81 ‚0018 .31 
B 30 . 33 . 0052 .30 
(6: 34 .25 .0188 .21 
р 30 .42 .0005 . 39 
E 28 . 36 . 0035 . 35 


effect of popularity оп the correlation between 
teacher- judgment and peer-judg ment was then 
Partialled out. Table I shows that the effect of 
Popularity was negligible. 
i It has been rather consistently r e ported that, 
Бе Our society, there exists considerable rivalry 
etween the sexes at preadolescence. If sex ri- 
it Ігу existed in these classes, to what extent did 
Influence pupils’ judgment of the curiosity of 
Hoc? of the opposite sex? To answer this ques- 
io the rankings which pupils of each sex gave 
1 lke-sex and opposite-sex peers were corre- 
ated with each other and with the rankings made 
У the teachers, The majority of the correlations 
еге moderate to high. All of them were positive. 
dh hile these findings indicated that there бав 
tea, Siderable agreement among boys, girls, an 
Cherg in judging curiosity, they did not answer 


the 
Questi, the whole, members 
Of б on of whether, on curious than 


ne sex were judged to be more 
А members of ihe SA. Two approaches = 
m O answer it. The differences between = 
boyas of the scoresthe peers had assigned to а 
nu and girls and the differences d 
in the” Of boys and girls the teachers had pues 
ТЫ and lower halves of the classes 


Table ariance of peer 


П shows the mean and v n 
sk irls for eac 
p quur or boys e classes the 


It i ft 
Shows that in three o == significant- 


boys S 
8 

ју tan assigned scores that we ——" 
Mother variable than those assigned to the Е who 
sco 10145, inthese rooms there Le ape en 
re Ted much higher than the girls in 


wer. 
еге also boys who were scored much lo 


Since the differences between some of the var- 
iances were significant, the differences between 
the means were tested with the Mann-Whitney U 
test. An examinationofthe means reveals that in 
some classrooms the girls’ means were higher 
than the boys’ means. In others, the opposite was 
irue. In no case was the difference significant. 
Although, on the whole, the teachers placed 
more boys than girls in the upper half of the class 
and more girls than boys in the lower half, this 
arrangement was not consistent in all classes as 
is shown in Table III. When tested, using the chi 
square technique, the differences were found not 
to besignificant. In light of the evidence it seems 
safe to assume that the ratings were not unduly 
influenced by sex preference. 

Intelligence was foundto be substantially relat- 
ed to both teacher-judgment and peer-judgment of 
curiosity. Teacher-judgment tended to be more 
consistently related to intelligence thandid pupil- 
judgment. Inall cases, the relationship was pos- 
itive and significant as is shown in Table IV. 

To obtain groups of pupils of high and low cur- 
iosity independent of intelligence, lines of regres- 
sion of curiosity on intelligence were drawn for 
each class and pupils whose scores deviated from 
the regression lines were selected. Pupils whose 
scores were at least one-half standard error of 
estimate above the regression line were included 
in the high curiosity group; those whose scores 
were at least one-half standard error of estimate 
below were included in the low curiosity group. 
This was done separately for teacher- and peer- 

The high-curiosity and low-curiosity 


i ment. 
judg hed from the two different judg- 


groups est ablis 
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TABLE Ш 


SEX COMPOSITION OF UPPER AND LOWER HALVES OF CLASS ACCORDING TO TEACHER- 
JUDGMENT OF CURIOSITY, CHI SQUARE, AND LEVEL OF SIGNIFICANCE IN 
FIVE FIFTH-GRADE CLASSES 


Upper Half Lower Half ауе? 
Room Boys Girls Boys Girls Chi Square Significance 
A Тж 9 8 8 „18 .75> р> . 50 
в 1 8 4 11 257 .50>Р>. 25 
© 12 5 9 9 . 81 .50>Р>. 25 
D 11 5 yi 9 1.14 .25> Р> .10 
Е 11 3 7 8 1.92 .25> Р> .10 

counted with the lower group. 


*Where the number in the class is odd, the person in the middle is 


TABLE IV 


TS BETWEEN 

- MOMENT CORRELATION COEFFICIEN 

"ш; AND INTELLIGENCE* OF PUPILS IN FIVE 
FIFTH-GRADE CLASSES 


-Judgment of Peer-Judgment of 
goodies Curiosity and I. Q. 


Curiosity and I. Q. 

Room N r N r 
A 31 „67 30 .33 
B 28 .60 28 . 65 
fe 30 ‚51 30 2% 
р 30 . 43 30 #32 
Е 29 E 28 .63 


* -Thorndike Intelligence Test. 
i ients based оп Lorge 
Intelligence quotien 


JOURNAL OF EXPERIMENTAL EDUCATION 


304 


153} ттез-әчО+ 


02^ «d *600`>а ээиеэтии81$ 
10 Тәләт 
8617 4 18 `6 = 
26 TET 66779 0c AYSOTIND лэмот 
86 '26 6676), ет Аузоттпо лецатн 
ээиеттел что М шә 


$НОМУУЛ МАЧА за ANV SNVSIA NSISIALSS SAINA 
"аза ЯО ЯОМУОІЯІМ№ОІЅ ANV AJLISORIOQO JO 'IVSIVHddV - 41145 
V мо SdNOUD ALISORIQ2-MO'I ANV -НӘІН ЯО AONVINVA ANV МУЧИ 


IA WISV.L 

oouejdo2oy TEDOS ТӘЦӘІҢ = 91008 тэмоТ» 
02 «d 06-<а 06 «d 0r'«d 05 «d 08 '«d ээчахтэазута Jo 
ооџеотии815 

6071-4 607-121 6Т`Т=Я т=з 95 '1=4 16°=1 
РТ 6LE 09 “SOT 60 '6РР 6 РОТ T9 786 06 '8cT 0c тәмот 
00 "Т82 10 “SOT 8177606 9786 69 “LP $8 `06Т SI лочатн 

929UELIEA итә 9OUELIEA uvoW 99UELIEA чези М шә 
ээчэзитэзат x Ап летпдоа asy 


AONADITTALNI аму 'ALRIV'IndOd ‘ADVOL SY запоно AILISORIQ2-AO'I ANY -HOIH JO NOSBIVdWOO 


A яПчу1, 


ments were then compared. Only pupils who were 
placed similarly by the two judgments were re- 
tained in the tentative criterion groups. 

The five regression equations based upon 
teacher-judgment of curiosity were not signifi- 
cantly different from each other; those based up- 
on peer-judgment were significantly different. In 
the latter case, aregression equation was written 
for the five classes as one group. The tentative 
Criterion groups yielded by the use of this equa- 
tion did not differ from those established by the 
use of the five separate equations. 

There were fifteen children who were judged 
by both teachers and peers to exhibit more curi- 
Osity than would be predicted on the basis of their 
Intelligence quotients. There were also twenty 
children who were judged by both teachers and 
Peers to exhibit less curiosity than would be ex- 
Pected оп the basis of their intelligence quotients. 
These groups respectively made up the tentative 

igh- and low-curiosity groups. Table V shows 
that the two groups did not differ significantly in 
аве, popularity, or intelligence. | 

Questions pertaining to race and sex bias were 
raised earlier. It seemed pertinent to raise the 
Same questions in regard to the tentative criter- 
101 groups, The limited number of Negroes made 
it impossible to reach definite conclusions, but 
Wo Negroes were included inthe criterion groups, 
One in the high curiosity group and one in the low. 
Ten boys and five girls were in the high curiosity 
8Toup, and seven boys and thirteen girls were in 
the low group. When tested, this was found to be 
а chance arrangement. It seemed likely that me 
d sex membership had not unduly influence 


Judgment Df ӨЙРӘ. | 
t Finally, the ry НИР of the Шаган Чп 
t ? tentative criteriongroups were examine Б 

һе Whole, the children in the high-curiosity group 
Bave themselves higher scores on curiosity t т 
sid the children in the low-curiosity group. Ав 
mown in Table VI, the difference between the 
Means Was significant at the . 005 level. din 
Was concluded that the tentative ст: erion 
ero PS were sufficiently established to be consid 

th °Ч the actual criterion groups. They Y t 
mee ctore, used to validate items иши eve 
dr pa e the curiosity of elementary 5010 


Erou: 


Mmary 


ig he purpose of the investigation wa 


ol chil- 
qre Tor шоп кира of еј теасћ- 
ег. іца. °Valuating measures 0 Бы self-judgment 
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of curiosity of childrenin five fifth-grade classes 
were obtained after the classes had been working 
together for six months. 

The judgments of teachers and peers were not 
significantly affected by race, sex, or popularity, 
but were significantly related to intelligence. 
With statistical control of intelligence, high- and 
low-curiosity groups were selected on the basis 
of teacher- and peer-judgment. Ona self-ap- 
praisal of curiosity the children of the high-curi- 
osity group rated themselves significantly higher 
in curiosity than did the children of the low-curi- 
osity group. The final criterion groups consisted 
of fifteen children of high curiosity and twenty of 
low curiosity. 


FOOTNOTES 


ж 


The research reported herein was performed 
pursuant to a contract with the United States 
Office of Education, Department of Health, Ed- 
ucation and Welfare. 

**A 29-page report describing this analysis and 
giving complete data in tables has been deposit- 
ed with the American Documentation Institute, 
Order DocumentNo. 6558, remitting $2. 00 for 
35 mm. microfilm ог $3. 75 for 6 X 8 in. photo- 
copies. Advance payment is required. 
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AN INVESTIGATION OF THE TEACHING OF 
CHRONOLOGY IN THE SIXTH GRADE 
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THE TEXTBOOKS basic to the teaching and 
Sàrning of the social studies are replete with 
Words and phrases relating to time and historical 
suronology, Despite the frequent oc cu rrence of 
inch terms, little is known about children's abil- 
y to comprehend them and to use them effective- 
tay y ede with the problem of this subject mat- 
ev field, Moreover, little is known --perhaps 
m en less-.about instructional material s and 
cthods which may increase understanding of 
ese terms. 
sea is article reports one attempt to secure re- 
a ch information in this relatively neglected a- 
Com he investigation involved the use of two 
stug able groups in Grade 6. While both groups 
Wee ‘ed the same social studies unit for авн 
fort S, namely, ‘Ancient C iv ilizations, " no è- 
Dils Was made to assist the teachers and бе pu 
Pupils. the control group. The teachers an д à 
hand. ОГ the experimental group, on the о y 
пи a the opportunity to try out the arten Ж 
born 12 aids to be described shortly. It is 10 ~ 
this с in mind, however, that prior to their use 1 
dence "Periment, there waslittle empirical evi- 
© that these aids would be really beneficial. 


Pian 
у 
1005 Related Research 


fa [лере is in general no lack of research on the 
Stan, "S that influence children’s ability to under- 
thera; Subject matter and to cope with Шерге 
ally M; but the research which relates speci c 
ject m, understanding and problem solving in sub- 
са] op E? making large use of time and histori- 
ost ТОПО 1ору is very limitedindeed. The ан 
Very Dru ent research reports are reviewe 
бау епу. | 
devaj Чеп and Sturt (1922) (5) in vestigated the 


* 


ertation by the 


bstr 
a , . 
Men for ап unpublished Se University of Minneso 


18 for the Ph.D. degree at 


same title, 


of chronology concepts, using a series of tests. 
They concluded from their test results and from 
their observations that growthin understanding of 
time is slow and that an adultlevel of understand- 
ing is not attained before the age of thirteen ог 
fourteen. While they were able to demonstrate 
differences in rates of development, they did not 
set up any particular program of instruction de- 
signed to accelerate development. 

Pistor (1940) (6) studied the effects of training 
on the development of time concepts. His method 
was to compare the results of two equivalent 
groups, one following a separate subject approach 
in history and geography in grades four and five, 
the other following, basically, a geographical ap- 
proach with history taught incidentally. The mean 
scores of the two. groups on the final tests of time 
concepts were about equal. Greater growth, but 
not significantly so, was reported after repeating 
the experiment with a similar program in grade 
six. According to Pistor, his evidence indicated 
that ‘‘maturation’’ is dominant over training in the 
development of time concepts. There seems to 
be, in his data, little support for this hypothesis, 

A third study, Friedman’s (1944)(3), dealt with 
the variety and importance of time concepts inthe 
life of both children and adults. Using interviews, 
tests, and time-lines, Friedman found that child- 
ren have a slight understanding of time when they 
enter school and progress in understanding with 
each succeeding grade, attaining full comprehen- 
sion of our conventional time system by the sixth 
grade and approaching maturity in comprehension 
of time concepts by thetenth grade. The rela- 
tionships reported between scores on tests dealing 
with time on the one hand and intelligence on the 
other were low, as were also the relationships 
between test scores and socio-economic status. 
Differences in performance on the tests by boys 


offered as partial fulfillment of the require- 
ta, 1959. 
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and girls were not significant. | | 

As a group, these studies agree in emphasiz- 
ing the difficulties involved in understanding time 
concepts; also in concluding that maturity in such 
understanding is the result ofa slow developmen- 
tal process. However, noneofthe three provides 
much evidence on the effect of organized instruc- 
tional attempts to increase children’s ability to 
understand time concepts asthey are employedin 
the social studies. It wasfor this reason that the 
present investigation was undertaken. 


The Present Study 


Subjects. The experiment proper was delayed 
until the initial testing program could be com- 
pleted. At this time, the Lorge- Thorndike Intel- 
ligence Test, Non-Verbal Battery, Level Ш, was 
administered. (The scores were later used also 
to divide the groups into three ability levels, 
from top to bottom, 110-145, 95-109, and 50-94.) 
Table I summarizes data on sex, average class 
size, and average І. 9. of the experimental and 
control groups, showing them to have been close- 
ly comparable on the factors mentioned. All sub- 
jects were drawn from the same mid-western 
city school system. 

Differences in Instruction. As has been stated 
above, both experimental and control gro ups 
studied the same social studies unit from the 
same textbooks and for the same period of time. 
The instructional program of the experimental 
group, unlike that of the control group, was in- 
tended to identify ahead of time certain anticipat- 
ed learning difficulties and to provide assistance 
in meeting them. It is to be re-emphasized, 
however, that the devices and suggestions offered 
had not been previously tested in order to deter- 
mine their worth. 

In general terms, the forms of special assis- 
tance given the experimental classes in the seven- 
week period were as follows: 

1. Specific identification of, and instruction 
in, every term in the texts relating to time. 

2. Use of various time-lines and charts to ада 
concreteness to such abstract terms. 

3. The writing of biographical and autobio- 
graphical sketches to stim ulate interest in past 
and present events. 

Testing Instruments Employed. Reference has 
already been made to the uses of 1) the Lorge- 
Thorndike Intelligence Test. 2) The comprehen- 
sion section of the Gates Survey Reading Test was 
used to control reading ability as afactor in later 
analyses. 3) Gains in the abilities essential to 
success in the social studies were determined by 
administering, both initially and finally, the Iowa 
Every-Pupil Test B, Basic Work-Study Skills. 

iu dM CMM 
ж The single word ‘‘treatment”’ is used here 


, 


int 
tion, differentiated as previously explained for 


he interest of 
the experimen 


4. In order to measure increases in the un- 
derstanding of historical time, the writer pre- 
pared an original test battery which was given 
both groups of pupils before and after the experi- 
mental period. Included were the follo wing Sus 
sub-tests: Vocabulary of Chronology, Ordering 
Four Events without Dates, Ordering Two Events 
without Dates, Relative Time, Ordering Four E- 
vents with Dates, and Time Absurdities. Thei- 
tems included in this battery were selected from 
information found in reference books, basal texts, 
and supplemental social studies books available 
to pupils in the intermediate grades. Reliability 
coefficients for the six tests, based onthe results 
of the initial testing program, ranged from . 98 to 
. 61 and indicate some variation in the consistency 
of these measures. Inter-correlations among the 
tests ranged from . 581 to .014 and reveal that the 
tests did differentiate fairly well various ways of 
measuring the understanding of historical time. 

Hypotheses Tested. The effects of the differ- 
entiated programs of instruction were measure 
principally with respect a) to gains in basic study 
Skills and b) to gains in understanding of time, 29 
determined by scores on the six separate tests. 
In each type of comparison, there was interest in 
the sex of the learners and in their levels of in- 
tellectual ability. The method of analysis adopt- 
ed may be illustrated with re spect to gains n 
basic study skills, which led to atotal of four hy- 
potheses, since sometimes additional controls 
(e.g., reading comprehension) were empl0 y € ^ 
and sometimes they were not. The four hypothe- 
Ses for basic study skills are: , е 

1. There is no significant difference in th 
final mean scores on the tests of basic 5 ums] 
Skills a) for the experimental and for the сити 
groups; b) for boys and for girls; апа с) for Level? 
of intellectual ability; nor is there d) a significan 
interaction between treatment* and sex or leve 
of intellectual ability. ше 
‚ 2. There is no significant difference in d 
final mean scores onthe tests of basic st" 4 
Skills, when the initial scores on these tests p 
controlled а) for the experimental and for t 
Control groups; b) for boys and for girls; ап d) 
for levels of intellectual ability, nor 15 thare 
a significant interaction bet ween treatment* 2 
Sex or level of intellectual ability. ‚ше 
‚ 3. There is по significant difference in dy 
final mean scores on the tests of basic B 
Skills when reading comprehension score? ‘ine 
controlled a) for the experimental and [07 с) 
control groups; b) for boys and for girls; АП д) 
for levels of intellectual ability, nor is there nd 
а significant interaction between treatment" 2 
Sex or level of intellectual ability. ao the 

There is no significant difference іл 
brevity, to refer to method of instr" 
tal and the control groups. 
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final mean scores on the tests of basic study 
skills when both the initial scores on these tests 
and on reading comprehension are controlled a) 
for the experimental and for the control groups; 
b) for boys and for girls; and c) for levels of in- 
tellectual ability; nor is there d) a significant in- 
teraction between treatment and sex or level of 
intellectual ability. 

No single score was computed for understand- 
ing of time and historical chronology. Instead, 
the gains on each of the six sub-tests are treated 
separately. For each of these, then, there are 
four null hypotheses correspondingto the four for 
basic study skills. The first null hypothesis for 
study skills needs merely to be re-worded, to get 
six hypotheses relating to understanding of time, 
by substituting in turn Voc abulary, 4-Event Or- 
der, etc., for the term study skills. There is 
therefore no reason to state in full the resulting 
twenty-four null hypotheses, expec ially since 
their nature will be clear enough when the findings 
are presented. 

Statistical Procedures. Allthenull hypotheses 
were tested by an approximate method of analysis 
of variance and covariance. The unequal frequen- 
cies resulting from the multiple classification of 
the data prevented the use of a more exact test. 
The robust character of thebasic technique of an- 
alysis of covariance (1, 2, 4) provides adequate 
defense for the techniques used, even though not 
all assumptions were satisfied. This fact, how- 
ever, makes it necessary to be somewhat guard- 
ed in interpreting results. 

Gross Findings--Basic Study Skills. At this 
point, only the data relevant to the comparisons 
labeled a) in the four null hypotheses are treated, 
those for comparisons b), c), and d) being post- 
poned for the time being. Inother words, the 
findings here in question relate to the experimen- 
tal and the control groups as whole S, under the 
four conditions described. The quantitative facts 
are assembled in Table II. None of the differen- 
ces between the two groups so far as basic study 
skills are concerned proved to be Significant, 
whether the comparisons are based upon the test 
scores alone or on the test scores with three type 
types of control: 1) initial scores onthe tests, 2) 
reading comprehension scores, and 3) both 1) and 
2). What this means 15 that the instruction de- 
signed to increase theability to deal withtime 
concepts had no discernible effects upon study 
skills as such. Perhaps none should have been 
anticipated since the types of training given the 
experimental group were speci al ized and could 
hardly be expected to develop skills either that 

are represented as such inthe study skills test or 
that could be generalizedto reveal their presence 

ransfer. 
E ec in Understanding Historical Time. 
Table Ш, like Table П, contains the results of 
comparing relative gains forthe experimental and 


the control groups as wholes. For each ofthe six 
tests of time understanding there are fournull 
hypotheses, as already explained, to make a total 
of twenty-four. In all twenty-four instances, the 
advantage lay with the experimental group, butin 
two, by margins so small as to be completely 
negligible (2-event order: no dates). In the re- 
maining twenty-two cases, all except four differ- 
ences are significant. 

Of the sub-abilities measured, one p roduced 
no significant differences at all in the relative 
gains made by the two groups. The correspond- 
ing test required pupils to arrange in correct 
temporal sequence two undated historical events. 
Why the instruction on the understanding of time 
given to the experimental group produced no ef- 
fects at this point is not known. 

Of the remaining five sub-abilities, the one 
making the poorest record (that is, favoring the 
experimental group least often) was 4-event or- 
der: no dates; and its similarity in psychological 
demands to the least successful of all (2- event 
order: no dates) is obvious. The experimental 


subjects surpassed the control subjects only а) 


when there were no controls at all (beyond that 


introduced by the differentiated instruction itself) 


and b) when reading comprehension scores were 
statistically controlled. Е 

Marked success attended efforts to teach child- 
ren in the experimental group a) the vocabulary 
of historical time, b) theability to distinguish be- 
tween the relative times of events, c) skill ^ 
placing four dated events in correct temporal ог 
der, and d) the ability to detect time absurditi a 
All sixteen potential differences are нпр i 
Since care was taken to prevent teaching La а 
would amount to coaching for the tests, it is tal 
lieved that the ѕирегіогіііеѕ of the lac api as 
children in these four sub-abilities are realiti 
and not artifacts. S. 

Findings Related to Sex and Ability Sub-group’ 
In this section of the report it will be possibi? ы” 
include only part of the data obtained when ер а5 
imental and control groups were treated no d of 
wholes, but in terms of sex sub- tests pen 
Sub-groups made upon the basis of intell pe the 
test scores. There were three sub-groups 0 
latter kind, tain- 

In Table IV are presented the F values ob ac 
ed when, with the initial scores controlled in а уе 
case, comparisons were made of the rel 118, 
gains on the seven criteria--basic study E ght 
and the six aspects of time understanding із арз 
the experimental group and tested in both £T nta 
before and at the conclusion of the experime 
period, g of 
According to the figures in the upper und e 
the table, the topmost of the three intel! IE the 
groups, whose scores had surpassed those O „у 
middle and lowest groups on the prelimi? а 19 
tests, maintained their superiority and а 
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TABLE III 


SIX SUB-ABILITIES, UNDERSTANDING OF TIME: SUMMARY OF F-VALUES OF THE 
ANALYSIS OF VARIANCE AND CO-VARIANCE TESTS OF THE SIGNIFIC ANCE OF 
DIFFERENCES BETWEEN MEANS OF THE EXPERIMENTAL AND CONTROL GROUPS 


Group Vocab- 4-event 2-event Relative 4-еуепі Time 
ulary order: no order: no time order: absurdities 
dates dates dates 

Е and C; no other-controls 26.89* 11.47% 2. 25 38.16* 40.99 18. 95% 
E and C; initial scores 
Опет 17.33* 2.61 es 43.75* 50. 50* 22. 91* 
E and C; readi hension 
чи екет Гаи 28.55* 11.43% 2.16 39.12* 45.08% 21.97% 
E and c. -— А 

Pb d readin 
“ana малаш e жалы == 44.10*  52.97% 25. 56* 


ж " 
Differences significant at the . 01 level. 


TABLE IV 


i -VALUES OF THE 
ELLECTUAL LEVEL: SUMMARY OF F 

је ЖЕ шлак TESTS OF THE SIGNIFIC ANCE OF DIFFERENCES, 

INTTIAL SCORES IN EACH OF THE SEVEN BASES OF COMPARISON CONTROLLED 


Sub. : = 4-event 2-event Relative 4-еуепі Time 
қ sroup НЫ E order: no order: no time order: absurdities 
skills y dates dates dates 
е " * 11.83* s $ а * 
l ог ability 19. 69* 9.76 


Sex B 
*D 
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it by significant differences in all but one of the 
Seven types of measure, namely, relative time. 

According to the figures inthe second row, 
there was enough differenceto be worth reporting 
only in the case of basic study skills and of the 
ordering of two undated events. In both instances 
superiority lay with the boys, but in only one of 
them, significantly so. 

An attempt was made to analyze the *'interac- 
топ” between method of instruction experienced 
on the опе hand and sex and intellectual level оп 
the other. (This type of analysis is represented 
in item d) in the four null hypotheses stated on a 
previous page. When, as in Table III, initial 
scores were controlled in all analyses, only one 
significant difference was found. This had to do 
with the ordering of two undated events, andit was 
accounted for by the excessive influence of the 
boys. The final mean scores on this criterion 
were higher a) for boys of superior ability, b) for 
boys in the experimental group , and c) for boys 
of superior intellectual ability inthe experimental 
group. 


Discussion 


Interpretation of the findings, tobe summariz- 
ed below, is dependent upon the conditions under 
which the investigation was made. а) А prime 
consideration is the validity and the reliability of 
the measures employed. Some information has 
been given above concerningthese matters, and it 
is believed that the quality of the measures is ad- 
equate for the purposes in question. b) All sub- 
jects were drawn from self-contained classrooms 
in grade six in a single mid-western community. 
How far the present findings can be generalized 
for samples of a different character, it is impos- 
sible to say. 

c) No controls were placed on the s ubjects’ 
previous educational achievement and experiences 
in the social studies orin any other area of the 
curriculum; that is, no controls beyond those of 
random selection and statistical analysis. d) The 
instructional program used with the experimental 
subjects had few provisions for c aring Гог indi- 
vidual differences. It probably would have proved 
much more effective with improvements at this 
point. " 

e) The vocabulary taughtthe children was con- 
fined to the time-terms of the basal Social studies 
textbook used by both groups of children. f) The 
experiment ran for only Seven weeks -- relatively 
long perhaps as such experiments go, but short 
when considered educationally. What effects of 
the experimental program would be with a longer 
period for learning is problematic. р) After all, 
but a single instructional program was tried out, 
and this without much prior evidence concerning 
the probable effectiveness of its various aspects. 
What might be accomplished by а different, or a 


better program, is also problematic. 

The findings of the investigation may be sum- 
marized as follows: 

l. The instructional program, which for seven 
weeks emphasized the identification of, and spe- 
cific instruction on terms relating to chronology 
and which made use of time lines and biographical 
and autobiographical materials prepared bythe 
children, fostered a) the comprehension of defi- 
nite and indefinite time-terms; b) the abil ityto 
recognize relative lengths of time between periods 
and to ascertain the similarity of time-distance$ 
with reference to given events; c) skill in ordering 
events with dates, and d) competence in recogniz- 
ing time absurdities. 

2. This instructional program had little or no 
effect on other study skills as measured by an ap- 
propriate test. 

3. Its usefulness in teaching the ability to or- 
der undated events varied with the number of e- 
vents to be placed in temporal sequence. It help- 
ed the more capable boys most when only two un- 
dated events were involved. 

Two additional observations seem to be war- 
ranted. The first is that, ifthe evidence adduced 
is trustworthy, we can say with confidence tha 
children can profit from systematic instruction 
of the kind undertaken, to increase considerably 
their understanding of and ability to use the time 
relationships common in the social studies. This 
judgment is in contrast with Pistor’s conclusion 
as stated above, which was to the effect that we 
can only wait for time to bring the desired сле 
es--the skills and knowledge involved аге the рг 
duct of maturation. h 

The second observation is based upon | анон 
evidence, which сап be only hinted at in ved 
port, that children encounter a good deal of prd 
culty in the social studies because of their de 
Ciencies in dealing with time relationships. di 
Success of the program set up for this study raa 
Plies the value of other investigations with ot ds 
plans of instruction, including devices and ml 
not used in this research. Long-time longitudine 
inquiries starting in gradeone should also po p 
а good deal of information for the improvemen i 
instruction at the points of interest in the геѕеаг 
described above, 
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me, НЕ PLACE GIVEN to arithmetic in the ele- 
imm 029 school instructional program has varied 
ШОН, time to time. At the end of the colonial pe- 
asd arithmetic had just emerged from occupying, 
he by Jessup (2), an incidental place 
tim n0 formal recognition of the subj ect in the 
6 € allotment in the daily program. However, 
Soo rapid development of commercial interests 
ject. brought out the practical values of this sub- 
half qu toward the end of the nineteenth century, 
tic, he school day was often devoted to arithme- 
tupo ting the last decade of the nineteenth cen- 
Ша many discussions were held concerniné the 
r е that arithmetic should occupy in the elemen- 

e ү curriculum and the proper content that should 
Prio ЕМ. The content and method of arithmetic 
oft T to 1900 had been directed toward 1) mastery 
he fundamental processes, 2) the extension of 


th 6 

оті, asi facts to the higher decades, 3) the mem- 

tha "ation of formulas, апа 4) the application of 
rent situations аз 


es А 
56 formulas in as many diffe 


ti 

abou лоша permit. Scientific studies Tere le 
900 and since then have witness- 

ia ШЕН edet t of methods of 


t cnt changes in the developmen 
ma arithmetic. 
Site ation of professi 
Several У guidebooks on th 
undam es in em 
Өресі © ental chang of arithme t ve 
a 
the А ле Subject. These sou 
of 441115 of arithmetic still point 


onal literature and el- 
ow reveals 


Mastery to include 1) a me 
2) Ding of numbers and the num 
development of the ability to 
те application of arithmetical p 
пе situations. e 
Bros, 1923, David Eugene Smith evaluatedthe pro- 
"n that had been made in these Words: dim 
orem about twenty-five years 280 ША ae 
Моца] ent for weighing values in arithmetic t 
Y began in this country. It was then tha 


berprocesses, 
generalize, 


rinciples 


works of promise upon the teaching of the subject 
began to appear, and it was only a little later that 
the text books first attacked successfully the un- 
real topics and problems of the past andseta 
standard for the real ones of the present and the 
future. Since that movement began there has been 
a veritable revolution inthe subject matter, in its 
arrangement, in the spirit with which it is pre- 
sented, and in the textbooks in which the work is 
set forth. ” (5) 

Research studies continued and newer editions 
of textbooks were published. In 1950, Wilburn 
and Wingo stated: 

‘In spite of the research and publications of 
findings in the psychology of arithmetic and relat- 
ed fields, and in spite of alarge number of im- 
provements in materials for teaching, the pro- 
gram of arithmetic in many elementary schools is 
not significantly different from the program of 
schools in the 1890's. There are superficial dif- 
ferences, to be sure, but in fundamental respects 
the same procedures and the same psychology of 
learning often obtain. ” (6) 

There is presently available animmense a- 
mount of critical, scientific material bearing upon 
the appropriate content and the best methods of 
teaching arithmetic. 

The textbook was chosen for analysis in this 
study as a source of the application of research 
recommendations. Reeder (4) in his historical 
survey stated that ‘‘the best expression of the 
methods of teaching any branch of the curriculum 
at any period of its history is revealed in the text- 
books of that period.’’ Judd (3) held that ‘‘there 
is no influence in American schools which does 
more to determine what is taught to pupils than 
the textbook, " while Bagley (1) referred to the 
textbook as the principal agency of instruction in 
American schools. 

This study was set up to discovert 
that could be found in the ac c eptance M 
ceptance of research recommendations in th 
teaching of arithmetic, as indicated by а Study ot 
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the content of elementary arithmetic textbooks 
published in the United States between 1900 and 
1957. A first purpose was to note the degree of 
connection between the recommendations made by 
men who had carried on scientific investigations 
in arithmetic and the changes that had been intro- 
duced into the content of arithmetic textbooks. A 
Second purpose was to check the recommendations 


which seemed to have been rejected by the authors 
of textbooks although presented as Substantiated, 


credible findings based upon scientific investiga- 
tion. 

Behind these two purposes were the ultimate 
intentions of 1) determining the status of arithme- 
tic research in the curriculum development pro- 
gram, and 2) isolating, if poss ible, reasons for 
the gap between recommendations for changes in 
teaching methods and the application of those re- 
commendations. 

The following questions were proposed: 1) Are 
the reasonably credible conclusions of research 
studies finding their way into textbooks? If so, at 
what rate? 2) Can reasons be identified which 
might explain the acceptance of some and ће non- 
acceptance of other credible research findings? 
3) Do the new textbooks generally recommend 
those techniques which have been tried out exper- 
imentally and found successful? 4)Isthere any 
evidence that some techniques are recommended 
by textbook authors before they have been tried 
out experimentally? 5)Is there a time pattern 
which is generally followed between the recom- 
mendation of research studies and their applica- 
tion in textbooks? 

An over-all review of the available literature 
on the research studies in elementary arithmetic 
was made to determine the trends that had devel- 
oped since 1900 in content and in method. Two 
lists were drawn up, one with topics which 
seemed to have been definitely influenced by re- 
search recommendations, the other containing 

topics which apparently had not yet been greatly 
influenced by research. Twenty-five topics were 
thus gathered together and presented to a national 
jury of nineteen experts who chose twelve for this 
ш? topics which were selected by the jurors 
arelisted here with the frequency of choice. 


LIST I--Topics that apparently have been influ- 
enced by research recommendations. 
1. Method of placing the decimal point 


in the quotient. 15 
2. Apparent method vs. increase-by-one 

method of determining the quotient. 13 
3. Imaginative settings for verbal prob- 

lems. mnes 10 
4, Placement of long division. 10 
5. Elimination of awkward and unre- 

alistic fractions. : 


6. Placement of common fractions. 


LIST II-- Topics that apparently have not yet 
Shown the influence of research recommenda- 
tions. 

1. Testing for concepts rather than for 


Speed and accuracy only. 19 
2. Developing and extending generaliza- 1 
tions rather than memorizing rules. 1 


3. Building concepts through the use of 
concrete materials in classes above 


the primary grades. 13 
4. The use of illustrations as visual 

aids rather than as decorations. 11 
9. Method of placing the decimal point 

in the quotient. 10 


6. Rationalizing division of f ract ions 
through using the common denomina- 4 
tor rather thantheinversionmethod. 1 


A survey was made to locate the research re- 
commendations and the critical opinionon each 
of these topics. This was followed by the exam- 
ination of 153 series of elementary arithmetic 
textbooks published in the United States by abe" 
ty-nine different publishers between 1900 an 
1957. Trends were indicated in two ways. Ta- 
bles were compiled showing the dates when the 
application of research recomm endations was 
noted in each of the different series. Then ae 
ures were drawn which showed the percentage О 
application at different periods of research ac- 
tivity. 


Summary and Conclusions 
= 610 onclusions 


Accepted Findings. Тһе effect of гезеа pet 
upon the content presented and th e methods pue 
gested in arithmetic textbooks was found to hav 
been direct and immediate in nine of the twelve 
topics investigated. he 

1. Between 1900 and 1917, 69.2 percent of the 
textbooks examined recommended using the ea 
Бег method for determining the placement of "n 
decimal point in the quotient. From 1917 to19 се 
all the textbooks presented this method but p 
1946, 93.7 percent recommend it while 6. 3 Pili 
c Suggest teaching the older, subtractive me 


2. The question of the choice between the бі. 
Parent and the increase-by-one method 0469 
mating the quotient has never been settled da- 
textbooks have followed rese arch recommen | 
tions. From 1900 to 1927, 51 percent of the ееп 
thors recommended the apparent method; betw іп- 
1928 апа 1940, 71,4 percent advocated the hi 
стеазе-ђу-опе method. Since 1940, the trend in 
been slightly in favor of the apparent method те“ 
57. 5 регсепї recommending this method, 107 
search has also shifted back to it. das 

3. Imaginative Settings have been ассер! = ng 
the bases for verbal problems, Between . 
and 1919, 79.1 percent of the books exami” 
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made no use of verbal settings; from 1920 to 1935, 
58. 6 percent made great use of such settings while 
Only 3.4 percent did not use them atall. Since 
1935, 90.0 percent of the books examined were 
found to make great use while 1.25 percent made 
ПО use of imaginative settings for verbal prob- 
lems. 

4. Awkward and unrealistic fractions also 
Showed very definite trends. When the books pub- 
lished between 1900 and 1920 were examined, it 
was found that only 17.5 percent had eliminate d 
Such fractions for the most part, while 42.6 рег- 
Cent made no effort to avoid them. Between 1920 
and 1930, 70,0 percent of the textbooks examined 
re eliminated them and since 1930, 94. 4 percent 

ауе been free from the large, awkward, and un- 
realistic fractions that were once widely used. 
Grade placement of long division and of 
common fractions has been raised. Examination 
9f books published between 1900 and 1906 showed 
that 61,5 percent of the authors introduced the 
Process of long division in third grade. Between 
907 апа 1930, it was raised to fourth grade in 
tha 2 percent; from 1931 to 1940, 50.0 percent of 
116 texts introduced it in the fourth, 30.0 in the 
ith, and 20.0 percent spread it out over both 
Brades, From 1941 to 1957, 81.5 percent have 
Placed it in the fifth grade. 
te Between 1900 and 1910, 36.8 percent of the 
*Xtbooks examined presented addition and sub- 
“action of common fractions in third grade and 
fou 1 Dercent introduced these two proce воа al 
ы» Tth grade level. From 1910 to 1930, 37. per- 
in nt advocated the fourth grade whilethe remain 
fon 2.1 percent divided the teaching uey e = 
Sense and fifth grades. From 1930 E ү P rh 
grad nt had moved the placement up tO Es 
fifth c and since 1940, 50.0 percent have ta i 
&rade with 44, 7 percent dividing the work е- 
stil] n fourth and fifth, leaving only 5.3 pe oe 
Presenting these two processes completely 
Ourth grade. | мА 
Multiplication and division of fractions sa g 
efinite trend. From 1900 НЕ. eds 


Реге 
While 67. 6 percent set the fifth grade 25 ДЕ 
апа 1407 introducing these topics. md ins 
1940, {һе fourth grade was elim on = 
бце > 47. 8 percent set the fifth and 30. p^ 
67. 69 the work in the sixth grade. Since E 
Cess Percent begin instruction in these two р 
ы re E the sixth grade. 
‚ UStrations are now use 
теснее 1900 ndi 937 when theearliest ere 
text, mendations appeared, 30.4 percen ge 
Ooks examined had no illustrations 0 | e 
tiong "hile only 16, 1 percentmade use of veri pe? 
the 5,25 Visual aids, Between 1937 and 1940, 4. 
Percents examined contained illustrations bu т 
Фар Were decorative опу, 23.5 percent 57 
ams Only, and 29.4 percent u$ ed the illus 


d as visual aids. 


trations as visual aids. Since 1947,80. 9 percent 
of the illustrations found in thetextbooks examin- 
ed were used as visual aids. 

7. The common denominator m ethod is used 
to introduce the process of division of fractions 
but is not presented as the basic method in any 
of the recent textbooks examined. From 1900 to 
1927, 55.5 percent of the books examined used 
the inversion method, 24. 4 percent the common 
denominator method, and 20.0 percent the recip- 


rocal method. Between 1927 and 1941, all the 
books examined presented only the inversion 
method. Since 1942, 75. 7 percent have advocated 
the inversion method while 24. 3 percent introduce 
the topic by the common denominator method but 
change to the inversion method almost immediate- 
ly. 
қ 8. The inclusion of tests designed to measure 
concepts was found to bea recent trend. From 
1900 to 1930. 97.0 percent of the texts examined 
did not include such questions. Between 1930 and 
1940, this figure dropped to 52. 6 percent as 31. 5 
percent contained some questions and 15.9 per- 
cent made considerable use of questions to mea- 
sure concepts. Since 1940, 46.0 percent of the 
books examined have made considerable provision 
for them while 26.0 percent did not have any of 
these questions. 

9. The use of materialsthat should contribute 
to the development of generalizations was found 
to be a very recent trend. From 1900 to 1945, 
92. 5 percent of the texts examined made no pro- 
vision for such materials. Since 1945 when the 
Second Report of the Commission on Post-War 
Plans stressed the need for this type of material, 
56. 3 percent of the texts have suggested consider- 
able use, 21.8 percent some use, and 21.8 per- 
cent have not advocated the use of this type of 
material. 

Rejected Findings. Recommendations pre- 
sented in research studies were foundto have 
been modified or rejected by authors of textbooks 
in three of the topics underinvestigation in this 
study. | : 

1. The major research studies which were 
carried on from 1926 to 1938 recommended that 
the introduction of the process of dividing by two 
or more figures be delayed until the sixth grade 
and spread out over three years. Modification 
of this recommendation was noted whenit was 
found that 81. 5 percent of the textbooks published 
since 1930 introduced the topic in the fifth grade 
and that none introduced it in the sixth or expect- 
ed the process to take more than two years for 
the complete presentation. 

2. Grade placement of common fractions fol- 
lowed a similar trend. The major research stu- 
dies recommended that these processes be spread 
out from the fifth through the ninth grades, and 
d that some phases should never ђе 


este! i 
Sugg It was found that addition and subtraction 


taught. 
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of common fractions have been placed inthe fourth 
grade by 5.3 percent of the texts examined, in the 
fourth and fifth grades by 44.7 percent, and in the 
fifth grade by 50.0 percent of the textbook authors 
since 1940. Multiplication and division of com- 
mon fractions have beenintroduced in the sixth 
grade by 67.6 percent of the authors but none de- 
lay it until the seventh. All of the processes are 
completely presented by the endof the sixth grade. 

3. The use of concrete materials in classes 
above the primary grades has not been strongly 
influenced by research findings as yet. From 
1900 to 1930, 96.5 percent of the texts examined 
did not recommend the use of concrete materials 
above the primary grades. Between1930 апа 1945 
many articles advocating such use appearedin 
professional journals and the examination of text- 
books showed that 82.8 percent still did not make 
any reference to these materials but that 17.1 
percent did. Since 1940, 39. 5 percent of the texts 
examined have advocated the use of concrete ma- 
terials in classes above the primary grades, 
However, no research on this topic was published 
until 1950. The few studies that were loc ated 
have reported that while such use has not retard- 
ed learning, no significant diffe rences could be 
found. Examination of textbooks indicates that the 
trend to include such materials has continued to 
increase strongly since 1954. 


The Status of Research 


The role of research in the arithmetic curric- 
ulum development program has been an important 
one. 

1. Many studies were designed to evaluate 
practices which had been in use for many years, 

2. When the recommendations were cl ear, 


concise and exact, they were inco rpo rated into 
some textbooks within five years. 

3. When the recommendations were general, 
intangible, or based upon subjective data, they 
were not applied as rapidly as where research 
findings were precise and well supported by ade- 
quate data. The lack of clearness and explicit- 
ness in the presentation of the recommendations 
led to slowly developing trends. 

4. Those recommendations which were pub- 
lished in the yearbooks of the National Society for 
the Study of Education and the National Council of 
Teachers of Mathematics tended to be applied 
very quickly. 
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TO THE STANDARD DEVIATION OF 
A DISTRIBUTION 
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introduction 


mid THE person familiar with the procedure, 
тин ТЕ access to a desk calculator, the com- 
15 nid of the standard deviation of a distribution 
Who d ifficult. Thereare, however, many people 
ut dà not have one or both of these requis ites 
нај Still find the standard deviation а useful 

is d ifit could be easily and accurately ap- 
Stand. imated. Teachers, for example, find the 
est A score an appealing unit for expressing 
toule Ss but will frequently not take the time ог 
Purpo е to compute the standard deviation for that 
Prob] Se alone. It was, in fact, this particular 
Procedu, that led the writer to examine various 
р ures for approximating the standard devia- 


lon É 
9f a distribution of test scores. 


The Rationale 


After examining a number of alternative pro- 
ing the standard 


сед, 
де уба, а method for approximat І n 
Seem àtion mentioned briefly by Diederich ( 
2d ed to hold considerable promise. This meth- 
the o PT esses the variability of a distribution as 
the | ference between two quantities drawn from 
Pro 415 of the distribution. The logic of this ap- 
lying р 1$ much the same as the argument under- 
a 


rai ne quartile deviation 
D. ua for two dis- 


trip, Sasure of variability. That is, wo di 
эш ays Фе опе ушр Ше greater variability 
Рагаы ve the greater difference between two com" 
БУ Points on the distribution. _ һе 
P. ni onn terms, this approximation ^ а 
“Presseq > of a finite distribution 


8- К [уху - 2X1] a) 


N 


`F Or б 
ters this finite example, the author 
and о commonly associated W 


ог 
а di E ч П еѕ, 5 
discussion of mean sigma distance®, 


has chosen te 
ith the infinite norm 


ee Wert (2:67). 


is an approximation of the standard 
deviation s= / E(X - X)? 
N 

K is a constant determined by the pro- 
portion selected for the upper or low- 
er groups (the method for computing 
K will be described in a following 
paragraph). 

N isthe total number of values in the 
distribution. 

ХХа is the sumof scores inthe upper por- 
tion of the distribution. 

EX; isthesum of scores inthe lower por- 

tion of the distribution. 


Where 5 


For initial convenience, consider X as a vari- 
able which is normally distributed. In this case: 


Хи = Np[ sl] +X] . (2) 


is an arbitrarily selected portion of 


Where p 
the distribution to be included in the 
upper (or lower) group of scores. 

y is the ordinate height at the point 
where the upper scores are divided 
from the remainder of the distribu- 
tion. 

Xands are the mean and standard deviation 
of the distribution of X. 
Similarly 


>Я = Np[sU S] +X] 5 (3) 
If not apparent to the r eader, H represents 


the average standard score in the upper group of 
scores, 2 Np the number of values (Scores) in 
either extreme group, and s and X the quantities 
needed to convert the 5 tandard scores to raw 


o use the symbols X and s rather than the Greek let- 


al distribution. 
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TABLEI 


` COMPARISON OF s AND $ FROM TEN ACTUAL TEST 
SCORE DISTRIBUTIONS 


Distribution N s 5 Error 5-8 
1 32 3. 71 3. 67 -.01 
2 32 6. 77 6.21 -.08 
3 36 9. 50 9. 72 +. 02 
4 64 12.90 12.87 -. 002 
5 32 . — 8.28 8.21 -. 008 
6 100 12. 00 12. 04 +. 003 
7 89 1.10 1.07 -.03 
8 82 5.20 5.19 -. 002 
9 32 8. 45 1.98 -.06 
10 12 3.22 3.17 -.02 

FIGURE 1 


ILLUSTRATING THE RELATIVE INSENSITIVITY OF 8 
DEVIATIONS AWAY FROM NORMALITY — 


1 


3 
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Score form. Since the normal distribution is 

Symetrical, for equal values of p, the expressions 

for УХи and YX) differ only in the sign of the av- 

erage standard score term. 

" jecit to equation (1) and simplifying we 
nd: 


a K 
8 = x[2Nps 5] (4) 
ог, 8 = 2Kys 


t , Since our intention is [ог 8 = s ina normal dis- 
ribution, we find: 


2Ky =1 
or, Ку = .500. 


Because y is a function of p, the proposition can 
be restated in the following way: if pis selected 
ie a value 0 = p=.5, K will be the quantity 
y. 
The choice of a value for p is a matter of con- 
venience in any practical problem and usually in- 
volves choosing enough values from the extreme 
Scores to smooth out chance fluctuations while 
not taking so many values that the work becomes 
Prohibitive. One point which the author has found 
сопуетіелі is to set рае. 167. When pis one- 
Sixth, у = 550 апак = 2. Thus, 8, the approx- 
bestion of 5, can be expressed as: the difference 
ҒА. en the sums of the upper and lower da. 
figs d Of a normal distribution divided by one- a 
© number of scores in the distribution. 


An Empirical Comparison of 8 and 5 
In the case of anormal distribution, 9 is ident- 


l with distribution 
5. n when the dis 
However, eve oximation to 


ber of actual 
th s comput- 


ка 
Sn 

5 “Ot normal, 8 is still a good appr 

di comparative purposes a num 
istributions were examined, Wl 
he usual way 


ВЕ 


test 
ed i 


and then approximated by the short-cut formula 
proposed above. Table I presents the results of 
these comparisons. 

In no case was the error over eight percent 
and in most cases in the order of two percent or 
less. Although the comparisons for only ten dis- 
tributions are presented, they illustratethe order 
of differences bet ween $ and s for a great many 
other comparisons which the author has made. 

To illustrate the relative insensitivity of $ to 
deviations away from normality, three hypotheti- 
cal distributions were constructed: 1 rectilinear; 
2 bimodal; 3 highly skewed (see Figure 1). 

Distributions 1 and 2 had errorsof -.04. Only 
in the extremely skewed distribution (error -.13) 
was 5 a questionable approximation of s. 


In all cases where actual test score distribu- 
tions have been considered, 8 has been entirely 
satisfactory as an approximation of s. In comput- 
ing standard scores, for example, the usual er- 
ror is inthe order of two to three percent. Be- 
cause such an error is insignificant in all but the 
most demanding situations, the writer has found 
the approximation described here extremely ap- 
pealing to teachers who consider the more con- 
ventional approaches to computing s too compli- 
cated and/or too time consuming to warrant its 
calculation. 
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COMPARING TWO METHODS OF 
WEIGHTING A SET OF SCORES 


CHARLES E. HALL 
Walter V. Clarke Associates, Inc., East Providence, R.I. 


Pei OF THE more common problems of ap- 
a ер прсте is the problem of combining 
Scor ection of test or item scores into a single 
Бус, Often the psychometrist must choose be- 
mu the simple sum of scores and a weighted 
some where the weights are derived according to 
Sion Optimum procedure, say scaling or regres- 
Sion Weights. In order to make a rational deci- 
Com. the psychometrist must either compute the 
the oe scores for each subject and correlate 
Sapa composites or follow a procedure like that 
In qp mended by Gulliksen (1950, р. 316 et seq.). 
doas > author's experience, the psychomet rist 

om not bother to go through the long, laborious 

re Putations, but rather selects from his own 

erences, the weighting system to be used. 


е 


Development 


ves P iSider Xik, a set of scores on к subjects 0- 

ме Measures, Letl = (lj)beone setof weights 

tain a Might be applied to these measures to ob- 
lx „одовде score as follows: 

— хр + 12Х2к +...1дХпК' | 

The рове m = (mj) is another such set of weights. 


e М 
as р Correlation between 1х and mx canbe written 
о оу: 


(1/п) рт“ Zymx 


x 
Мақы lxeme я 
JEy(mx)? - (i/n) и 
(2) 


5 Xxx)? = (1/п) (2k mx)? 
ве we restrict the x scores 5 
With t 1 and Zyxy = 0. 
Бро his restriction a simp 
^ Uylx -OEkZgljXik 
= Балон) 


o that 


lification occurs. 
irst 


> = 24 + 0= 0, since 
Equ,,, ОЧЕ = 0. 
E ‘ation (1) then reduces to 
1х У хех (3) 


: Mx = — . 


(ay Now 1 КЮ. Уш 


ion 
et us consider the numerator of equatio 


Зах. тах № 
= Х| (Zilixik) бк 
= Zk Z;Z jl jmjxikXik 


: - Z;Egmj(Xyxikxg). 
With the restrictions (2) above, EkXiyXik = rjj 
jk > Тір 
and the numerator reduces іо 2;£jljm;r;; = Ел; 
where R is the correlation matrix between the un- 
weighted items or test scores andland m are 
treated as vectors. 
The denominator of equation (3) can be reduced 
by a similar process tovIRi'' v mRm' . 
Equation (1) finally reduces to 


Tix mX ЛЕР V/mRm (4) 
Discussion 


The correlation gained from this procedure is 
somewhat analogous to a reliability coefficient 
and, to the author's thinking, ought to be handled 
in the same way. Althoughthe sampling error of 
Nx is that of the product moment correlation, 
the’interest here is the replication of information 
for the two weighting systems, not the testing of 
a null hypothesis. Because ofthis, only high val- 
ues of r]x, mx ought to be considered as accept- 
able. 

It is possible to test the '*un-correlation"" of 
two sets of weights by testing the significance of 
the coincident coefficient of alienation, 


а= је т 
. (1) lx,mx 


wo conveniences occur when using this tech- 
nique to handle data. 1) This procedure is insen- 
sitive to multiplying allthe weights of 1 by a con- 
stant. 2) This procedure isinsensitive to the 
means of the scores. 

To show that the set of weights al = (al, , alz... ) 
is comparable to 1 = (1,,12...), we may merely 
substitute al for m in equation (4). 

rix, alx = 1R(1a) 


УІН 7 У(а) Ва) 
ei а. =l 
ау (IRI )? 


To show that the procedure is insens itive to 
means is more complex. First, consider the 
(weighted) covariance of 1(х+а) and 1х. 
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TABLEI 


| 
= | 
uU 

= я = * 

еда d as d E 

РЕ Еа BS 9 8 Б | 

Бо 56 Б) 2а. D А E m | 
Test оо өзг © d m p = = 

| fo ES g 5 П.Ф Я оз 

Hu я ч % 15 ы 5H 
с T he БОБ d n av шо os 
Title біз NES Ча = = LR = a Б 

! 8 [Э E әт оз o 5% 

= 

КЕ 0 ШЕ Е 59 E 2 

E H S cs 25 gm 38 Hu 

ЖОЕ Qs о с 2 oh ?g Bu р 

= B = E 58 EN з 8 РЕ: 

d d 5 о [2] 
30 38 58, BE Ho ER A 
OR Oo ба BR Еш Ея Еш 


Rotated Orthogonal Factor Coefficients 


Visualization 160 637 
Perceptual Speed | 377 269 515 -014 
Space 333 217 


Visualization 7045 
Perceptual Speed | 266 165 | -065 -143 -005 | 459 -131 
| 
Space 194 116 | -259 515 | 099 | -067 -217 
Standard Deviations 
11.80 9.43 | — 11.06 19.69 | 5.74 6.78 2.20 


Visualization 


Perceptual Speed 11.80 0 | 0 8 


! 
Space 11.80 | 0 | 0 39.38 , 


< ! о 0 0 


Raw Score Coefficients 


Visualization 0 А 0 1 9 | 2 | 0 5 
| 
PerceptualSpeed 1 0 | 0 0 | о | 2 0 
| | 
— ME: 0 | 0 à | 0 0 0 
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TABLE II 


RELATIONSHIPS BETWEEN THE TWO SCORES 


Factor r а= \1-г 
Visualization .98 .20 
Perceptual Speed .91 .41 
Брасе .84 .54 


ХұЦхғайх - (1/п)Уы (хға)” Exlx = 
У(1х'1х+1а”1х) - (1/п)[ Z1xela]- 21x = 
УЛх']х+УЛајх - (1/n)(Zlx)? - (1/n)ZlaZlx. 
Now la = l,a, + 12а2+. .. щак is a con stant; al- 
Wing the reduction 
2х)? - (1/n)(Zlx)? + laZlx - (1/n)n: la: 2х = 
= (Ил). = 
la). nd, consider the (weighte 
Уха): ха) - (1/n)[ ®1(х+а)]® = 
3 DO ias oa - (1/n)(Z1x)? 
n)ZlxXla - (1/n)(Zla)? = 
а (1/п)(Б1х)#+21а®1х - (2/п)п1а®1 
/n)n?(la)? = x(x)* - (1/n)(21x)?. 
Bae us the covariance of 1(х+а) is al 
Ariance of Ix, showing that the corr 
Үреп 1(х+а) and 1х is 1. 
the "iod technique, however, 
riance of the x scores. 


lo 


d) variance of 


x«n(1a)? 


so equal to 
elation 


is not insensitive to 


Ап 


Example 


iue following example is ¢ 
pi е сап be used to aimp yi 
rq (07 Scores. Michael, Zim | 

sin 1951) collected information about high uw 
Write. USing seven spatial relations tests. E 
ic" factor analyzed the information using ai 
to a у Factor Analysis and rotated three — 
eq а €aningful orthogonal structure. The теа 
n efficients are presented in Table I. Su a 
Uniy, Y» the factor score coefficients regres ш 
rom "late test scores onto the factor scores = я 

Bolein xà according to the procedure outlined by 
12, jg) €*" and Harman (1941, p. 268, equation 
Ent ор’ These also appear in Table 1. The pres- 
tions Jective is to simplify these regression edu. 

Y Substituting simple integers ОГ zer 


the decimals. 
One of the difficulties of the procedure is that 


itis sensitive to the variance of the scores. 
Since the factor score coefficients are associated 
with univariate scores and it is desiredto use in- 
tegral coefficients with raw scores, a little jug- 
gling is required. If LX denotes the combination 
of integral coefficients, L, and the raw scors, 
X, then (Lo) (®) adjusts the raw scores to univar- 
iate scores arid the integral weights to comparable 
factor score coefficients simultaneously. 

The trick to developing comparable integral 
weights is to find products of integers and stand- 
ard deviations which are proportional to the re- 
gression coefficients. Таре І also presents the 
standard deviations which are approximately pro- 
portioned to the factor score coefficients and the 
integral raw score weights. The use of these in- 
rs makes it possible to compute reasonable 


tege 
approximations to the factor scores with an adding 
machine. Таре П shows the correlation between 


the actual factor scores апа approximations ob- 
tained from integral weights. Perhaps better in- 
tegral coefficients could be obtained from a more 
diligent search of the possibilities. 
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SECTION I 


TI 5 
ће Problem and Its Background 


THE р 
ыы ге йр OSE of this investigation is to study 
the ity and x between certain aspects of per- 
Study is жырды сеу: More specifically, 
Profile ta the relationship between Scores 
ing; 9ality In ternson the Minnesota Multiphasi¢ 
ventory and success in teaching as 


. leateq 
by princi 
8s. Y principals’ and superintendents’ rat- 


T 
Pe. Tete: is consi 
nsiderable evidence from previous 


Sea 
pus; СО to indi 
P ai шы сае HE teacher ratings based on 
and supervisory ratings of teachers 
жж and 11159, 


e 
{ DOt hj 
ч скале У correlated. Rostker 
Pervisor » €ach concluded that pupil gain and 
hio MM are not related to à greater 

> “Wh can be attributed to chance. Lins 
la, at a ever is measured by each of the 
ing Sla do east it appears evident that these 
сеп not measurethe same aspects of teach- 
Pil Chers 4; 3 тарике summarized, «Ratings 
Bain ›› 40 not agree with the criterion of pu- 


Тең регу! 

тоң o аш ratings of teachers, then» must 

a Omething other than efficiency in QU 
he 


Der, B Pupil ра; 

tiyg nal 4 E gain. They probably 
8581 йе; 
оазе елер С1РИпе. An examinatio 
he 3 relative to the strengths 
овога p eachers rated by the pri 
€Sponding to the inquiry W 
опсега except for discipline, 3 

Tacten uct the raters was with the perso! 
ant Vis oes of teachers. . 
le g OTS in Systems used by рг! 
rating teachers differ 
This, which would t 


lon, 2 
5 
to zero, is a possible Г 
Ж 
T 
rofess 


low correlations between th 8 
and. the pupil gain лена P напа ore tating 
any relationships which have been теза Boh beste 
supervisory ratings and other data exist between 
of the diversity in supervisors’ value 5 B "o! 

Regardless ofthe meaning of Bie E 

ratings, teachers are usually judged yr the visory 
pervisors and administrators. In seneti these 
evaluations are made upon the basis of Еј a 
impressions made ofthe teacher in many Loses = 
al contacts, in observing classroom perform "€" 
and upon reports from others, rather е! 
а singleobjective measure of teaching eifictenay, 
The impressions may dependto a large exte = и 
on the teacher's personality, but the denies Aps 
whatever its basis, becomes the official Permis, 
tion of the particular school system in which the 
eris employed. Regardless of what el he 
the teacher may have done, right or wrong, if e^ 

leases the administration he is rated hight А 

ntly is considered to be a good uie 


conseque 
be said, also, that in spite of the inade- 


It can 
uacies of supervisory ratings, the local admin 


supervisor shouldbe in a е 
the abilities of the сла (жер 
sons who must base their judgments on ане 
observation. Іп апу case, it seems that „ен 
visory ratings are very important when со Res E: 
ering а teacher's success. sid- 
As to the aspect of teac hing he 

study, a teacher's personality is apt, posa 
to the thinking and researches of many сон 
to influence his success in teaching. Ғы sons, 
qualities aífect his classroom electivenoas, hid 
enthusiasm, his pupil contacts, his disci i his 
his contacts with fellow teachers and with the ine, 
izens of his community, or other aspects A i 
life as a teacher. Certainly, extreme ab of his 

personality determine a teacher's живо 


alities in] ona ^ 
tiveness in guiding pupils in the learning-teachin, 
g 


teach 


q 
istrator ог 


tion to judge 


S. Barr, who served as his major pro tesso 
r, 


he 
Qn, ац 
d thor ys ог А: 
іре p ic to express his thanks to Jingness, pothof whom servedonthe author'sthesis committee 
i эзогв 1, E. Drake and Т. 4- 4 
+ article. 


no á 
tes will be found at end 9 
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situation. The study here reported purports to 
explore the influence of certain personality ab- 
normalities as measured by supervisory ratings. 

It is expected that this study will discover such 
relationships as may exist between teacher effec- 
tiveness as measured by supervisory ratings and 
Scores on the MMPI. 


SECTION II 


The Procedures Used in the Investigation 


Design of the Study 


The study here reported attempts to compare 
the ratings of teachers who were rated outstand- 
ing, above average, average, below average, or 
poor by their principals or Superintendents, with 
Scores on the MMPI. 


The Minnesota Multiphasic Personality 
Inventory 


The MMPI is а psychometric instrument devel- 
oped at the University of Minnesota by S. R. 
Hathaway, Professor andDirector of the Division 
of Clinical Psychology at the University of Minne- 
sota, and J. C. McKinley (dece ased), formerly 
head of the Department of Neuropsychiatry at the 
University of Minnesota. The Inventory was de- 
signed to provide scores on all of the more im- 
portant clinical phases of personality. Although 
it was standardizedon 1500 normal individuals and 
220 psychopathic patients in the University of Min- 
nesota Hospital and was designed primarily as a 
clinical instrument, it has been used very exten- 
sively in a great variety of experiments of a non- 
clinical sort. Albert Ellis?, in the Fifth Mental 
Measurements Yearbook, says, ‘If can confi- 
dently be stated that in the whole history of mod- 
ern psychology there has been no other personal- 
ity inventory on which so much theoretical and 
practical work has been done. "' The Fifth Mental 
Measurements Yearbook lists 495 studies about 
or with the MMPI. Accordingly, including those 
listed in previous yearbooks, there has been a total 

of 779 studies through 1958, relating to this par- 
ticular instrument. Most of the ear ly research 
on the Inventory was done in a hospital setting, 
but later research was conducted with normal per- 
sons and in relation to various situations. Drake 
and Oetting" state that 4... almost all the pub- 
lished work has reported studies of the individual 
scales. While information about the individual 
> les тау be useful in some instances, (ће be- 
le that the counselor is tr y ing to understand 
redict is usually too complex to be measured 

= quee scale." Accordingly, attention has 
tie shifted to patterns of scales as well as indi- 


vidual scales. 


The group form of the MMPI consists of 566 
statements covering awide range of subject mat- 
ter, from physical condition of the individual be- 
ing tested to his morale andattitude8, In admin- 
istering the test, the subject is asked to respond 
to all statements which are in the first person, as 
True, False, or Don't Know. An ІВМ machine- 
scoring answer sheet has been adapted for this 
Inventory by Professor L. E. Drake of the Uni- 
versity of Wisconsin Student Cou nseling Center, 
which has greatly facilitated the scoring opera- 
tions. 

The Inventory scales, of which there are ten 
plus four correction scores, were developed ser- 
ially from 1942 to 1951. This probably accounts 
for the fact that most of the earlier research with 
the MMPI has been with individual scales rather 
than profiles. 


Data-Gathering Procedures and 


Subjects of the Study 


The MMPI was administered to entering fresh- 
men during freshman orientation week at the Un- 
iversity of Wisconsin. The scoring was done by 
the University of Wisconsin Student Counseling 
Center. Personality profiles for the subjects of 
this study were obtained from these score cards. 

A list of all students who received the Univer- 
sity Teachers’ Certificate along with the teaching 
fields of these students was secured from the files 
of the Office of the Dean of the University of wis- 
consin School of Education. The teaching posl- 
tions held by the subjects were obtained from the 
files ofthe University Teachers’ Placement Of- 
fice, the University Alumni Office files, and from 
the official directories ofthe public schools of the 
state of Wisconsin. 

Letters were sent to all known principals and 
superintendents of teachers in the study asking 
their cooperation in rating the teachers involved. 
The rating blank asked for comments regarding 
elements of strength in the teacher’s wo rk, the 
elements of weakness inthe teacher’s work, gen- 
eral comments, and an overall rating on a five- 
point scale. 

Tabulations of the ratings, comments, and pat- 
terns of personality scores were then made an 
relationships among the various data sought. 

The subjects for this study consisted of all the 
students enrolled at the University of wisconsi" 
during the fall semesters of1949, 1950, and 195 : 
who receivedthe University Teachers' Certificat? 
in 1953, 1954, 1955, ог 1956, and who have taug” 
in the public schools of Wisconsin. It was m 
(hat a total of 431 students from the freshman 
Classes of 1949, 1950, and 1951 had taken t^ 
MMPI, had graduated in the years 1953-56, a 
had received the University Teachers’ Certificate 
Due to the Korean situation and other matter? 
many of the males who had originally enrolled 
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not graduate and many more who did graduate did 
hot go into teaching. Marriage and decisions not 
to teach removed m any of the females from the 
list of teachers. For others, no record of post- 
&raduation activity could be found. In somé cases, 
due to the death of a principal or superintendent, 
ОГ to his moving to an unknown location, it was 
Impossible to get a supervisory rating on a par- 
ticular teacher. Ina few cases the administra- 
tors and supervisors failed to supply tne ratings. 
The number of teachers for whom complete data 
Were secured was 167, of which only 20 were 
males, 

Although this is not intended to be a sampling 
Stu dy, there appears to be no reason to believe 
that the people here studied were greatly different 
from other people who graduate from the Univer- 
Sity of Wisconsin School of Education. Since this 
18 а very limited population, users of the data in 
this Study may be interested to know more about 

© group. Considering the group of 167 as a unit, 
this population was different trom the usual in that 
poly twe nty were males. For this reason, and 
cause highor low scores on many of the MMPI 
Scales mean different things for men and women, 
© female po pu lation of 147 was studied separ- 
мер, ОГ this group, nine were music teachers; 
ti elve, teachers of art; thirteen, speech correc- 
t Оп; fifteen, phy sical education and aei 
ue У-їһгее, home economics; six, business ed- 
Cation; fifteen, elementary; eight, social studies; 
Ер Mathematics and science; and оте Ag 
nglish, foreigh language, speech or library. e» 
~ Brade-point averages of 2. 5 or better "m 
Sinning of their junior year. In general, t гу 
oo red to be a typical University of [sopra 
Not 901 of Education group Assuming ae a 
еп much change in the basic characteris ей 
Гед, Diversity of Wisconsin students, the rpm 
for, 18 referredto Lins9 study for ies тошу 
of m ... atypical univer sity 5 
Students. à 
tha е рова, wich was in more 
Cure alf the cases, twoor more oe did 
Not qp P each teacher. When these г erage 
тан 9" 86, they were averaged and eae d 

"n8 us ines differed, they differe 

by оп ед. When ratings di 
У One rank. 


n 4 
Or з, (ап of 2.5; forty-two were га! 3.5; seven 
We 4; and two 
Те teach- 
Srs jp ated poor or 5. Either most of the 


Chers. Because the frequenc 4 

were 
Сот P Ategories were rather small, 4 iof 
ed as follows: eighteen teachersi he jor 
8 group, seventy-five ca s es 1n 


2.5 rating category, forty-five in 3 ог 3. 5, and 
nine cases in the 4 or 5 rating group. 


Coding the Data 


The scores on the MMPI had been coded ac- 
cording to the method of Hathaway.10 The scales 
were assigned numbers as follows: 


Si Social Introversion-Extroversion 
Hs - Hypochondriasis 

D - Depression 

Hy - Hysteria 

Pd - Psychopathic Deviate 
Mf - Masculinity- Femininity 
Pa - Paranoid 

Pt - Psychasthenia 

Sc Schizophrenia 

Ma - Hypomania 

None 


О со -л с› сл > со од = О 


Raw scores had first been converted to stand- 
ard T scores. (T scores have a mean of 50 and 
astandard deviation of 10). In the coding, the 
number of the scale with the highest T score was 
written first, then the second highest, and so on 
down. No score which fell within half a standard 
deviation on either side of the mean was record- 
ed. This means that only scores of 55 or above 
were coded high. After the high scores had been 
listed according to the number of their scales, a 
dash separated the low scored scales. These 
were listed by scale number withthe lowest scored 
scale first, the next lowest second, and so on. 
No score above 45 was coded low. Tied scores 
were underlined. Thus, ifa person's profile code 
is 3987-645, it means that the highest score was 
made on scale 3, the score on scale 9 was equal 
to that on 3 or differed by only one point, the next 
highest score was on scale 8, and the next on 
scale 7. Scores of 55 or above were made on all 
ofthese scales. The lowest score was made on 
scale 6, the next lowest on scale 4, and the next 
on scale 5. Thescoresonthesethree scales were 
all below 46. Scores on the remaining scales (0, 
1. and 2) were withinthe normalor average range. 

у This system of coding has been recommended 
because it expresses both intensity and pattern 
and at the same time effects a compromise be- 
tween too much detail on scale elevation and equal- 
ly undesirable detail as to profile shapell, 
Du Мав12, in discussing problems of profile an- 
alysis concludes, “И predictionor diagnosis isto 
be maximally good, both intensity and pattern 
must be operative in a profile. "* 


Methods of Analyzing the Data 


There are many theories of mental structure, 
organization, and techniques for the validation of 
data-gathering devices with reference to these. 
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The conventional statistical techniques for test 
validation appear to rest upon the assumption of 
the additive nature of the constituents of human 
abilities and personalities. This study does not 
make this assumption and, accordingly, a differ- 
ent technique of validation has been employed. 

It is thought by many researchers in personal- 
ity that patterns of personality traits, the ways 
in which various phases go together, are the im- 
portant determinersof personality manifestations. 
In some cases one scale reinforces another, while 
in others one scale com pensates for or offsets 
another. Forcertain scales extreme Scores 
seem to be the only important ones. The most 
promising recent research, especially that of S. 
R. Hathaway and L. E. Drake, has been conduct- 
ed with reference to these ideas. 

In the present Study, comparisons were made 
between Supervisory ratings and highest ranking 
Scales, combinations of high ranking scales, and 
combinations of high scales and low Scales. It is 
hypothesized that personality profiles on the 
MMPI are different for highly rated teachers than 
forteachers who are rated lower. McCalll3 found 
a relatively close relationship between teacher 
personality and pupils’ comprehensive growth as 
measured in his investigation. 

Various procedures were employed in analyz- 
ing the data. Among these was the chi-square. 
When a chi-square large enough to be encourag- 
ing was found, the data were examined more 
closely and other tests were made to see if a ге- 
lationship between a particular rating and a scale 
or profile pattern might be more firmly estab- 
lished. Since in most cases the chi-square sta- 
tistic was usedtotest whether having a particular 
scale or combination coded in a certain manner 
or not having it coded thus was statistically sig- 
nificant in regard to supervisory ratings, the ex- 
pected frequency of each cell becomes a matter 
of interest. 

Inasmuch as there are forty cells in a 4 x 10 
table which was employed inthe overall chi-square 
analysis, the expected frequencies for 147 cases 

would naturally not be large. In many instances, 
they fell be low the minimum of five or ten fre- 
quently thought necessary for such analyses. 

Under the null hy pothesis it is assumed that 
having a particular personality trait has no rela- 
tionship to supervisory ratings. For example, 
as shown in Table I, twenty-four female teachers 
had scale 3 (Hy) coded highest of all the scales. 

der the null hypothesis, one would expect these 
= four cases to be distributed among the su- 
twenty - ші ratings proportionately to the way in 
DNA total 147 cases are distributed among 
which the t tings. Seventy-five of the 147 
the supervisory rating ^: 

achers were rated inthe second category. Ti hen 
= expected frequency for the cell B 
scale 3 coded highest and supervisory rating o 


2-2.5 would be that part of twe nty-four that 
seventy-five is of 147. This is 12. 24. 

In this use ofchi-square, the data are put into 
various categories (e. g., the dichotomy of having 
а scale coded high or not high on one hand and the 
four-fold categorization of su pervisory ratings 
on the other). These categories should not be in- 
terpreted as points on a scale. 

Chi-square is a measure of the amount that 
observed frequencies differ from expected fre- 
quencies in the various categories. In this study 
most of the observed frequencies were about what 
one would expect. This is indicated by the chi- 
Square values, only a few of which were large 
enough to be statistically significant. 

Tate and Clellandl4 say, **The test (chi-square) 
is the best available for enumeration data from а 
manifold population. It gives good results even 
when the expected frequency in one or more cat- 
egories is as low as one, provided that the ma- 
jority are about five or more." Not all authors 
agree with Tate and Clelland's statement regard- 
ing the use of chi-square and particularly the 
minimum number required for expected frequen- 
cies. Sincethe number in each category is rather 
Small in some cases (after the data are broken 
down into sub-categories) chi-squares have been 
figured in several instances where the statistical 
Significance of the result must be seriously ques- 
tioned. Many authors 4015,16,17, however, ae 
dicate that the heretofore commonly accepted min- 
imum expected frequency of five per cell is [00 
high, especially when there are two or more de- 
grees of freedom. In this study there are thre 
degrees of freedom for most of the chi-square 
tests. 

In addition to the chi-square tests, the per- 
centages of occurrence of the various patterns O 
high and low scores were calculated for each - 
the four rating categories. It was thought c 
Such data would enable one to make certain qual- 
itative analyses of profile patterns in relation to 
the super visory rating. The following profi 
patterns were compared: 


l. The frequency with which each scale of ve 
three highest scales occurred with eve 
other scale coded high (above T = 54). the 

- The frequency with which each scale of 
three highest scales appeared with eac 
the two lowest scales. This was done 
each of the four rating categories. ded 

3. The frequency with which each scale с нр 

anywhere high (above Т = 54)оссиггед W^. 
each scale coded anywhere low (pelo тв 
46). This was done for the highest г 
group. 


wn 
The data obtained in these comparisons are sho 
in the tables reproduced in Section Ш. 


ТАВГЕ 1 


FREQUENCY OF SUPERVISORY RATINGS OF FEMALE TEACHERS WHO HAD VARIOUS MMPI 
SCALES CODED HIGHEST OR TIED FOR HIGHEST 


Scale Coded High- 
est or Tied for 


Supervisory Rating 


Highest 1-1,5 2-2.5 3-3.5 4-4 7-9 
N = 141 18 75 45 9 D.F. = 3 
0 11 2 (1. 35) 7( 5.61) 0 (3. 37) 2 (0.67) 7.177 
1 3 1 1 1 0 

2 3 1 1 1 0 

3 24 T (2.94) 11 (12.24) 5 (1. 35) 1 (1.47) 7. 934 
& 11 2 (1. 35) 4 (5.61) 4 (3.37) 1 (0. 67) 1. 142 
5 18 2 (2.20) 12 (9.18) 4 (5.51) 0 (1.10) 2. 133 
6 18 1 (2.20) 10 ( 9.18) 6 (5.51) 1 (1.10 . 893 
q 30 1 (3. 67) 16 (15. 31) 11 (9.18) 2 (1.84) 2. 954 
8 8 0 5 2 1 

9 30 4 (3. 67) 16 (15. 31) 9 (9. 18) 1 (1. 84) . 560 
x 4 1 0 3 0 

*Number in parentheses following observed frequency is expected frequency for that cell. 
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SECTION III 
The Analysis of Data 


The purpose of this study, as stated in Section 
I, is to explore the relationship between scores 
and profile patterns on the MMPI and success in 
teaching as indicated by Supervisory ratings. The 
study isdesignedto discover whether or not there 
are differences in the personality patterns of suc- 
cessful and unsuccessful teachers. 

In order to carry out the stated purposes of 
this study, it was necessary to submit the data to 
certain statistical analyses which will be ex- 
plained. The datain this study are nonparametric 
in nature and, consequently, any statistical meas- 
ures employed should be of the non parametric 
type. The methods of securing the supervisory 
ratings and of grouping them into four categories 
were explained in Section П, as was the method 
of coding the scores from the MMPI. 


The Female Teachers 
2 2052625 Aeneners 


The following discussion is in reference to the 
group of 147 female teachers only. 

The frequency with which eachscale was coded 
highest or tied for highest for each of the four su- 
pervisory rati ng categories was first tabulated 
(Table 1). Becauseofthe low frequencies in some 
of the categories certain planned techniques had 
to be abandoned. However, chi-squares were 
figured for cases which had a total N of 11 or 
more. Whenever the chi-square value was large 
enough to suggest some relationship, closer ex- 
amination of the data were made. In most cases 
chi-square values were calculated using a method 
advocated by Lindquist18 which is less time con- 
suming than the traditional method, but which is 
the algebraic equivalent of the traditional, 19 

Only one group—the group with scale 3 (Hy) 
coded highest—seemed worthy of further investi- 
gation. A chi-square of 7. 934 with three degrees 
of freedom was found for this group, indicating 
that having scale 3 (Hy) coded highest might dis- 
criminate among the female teachers in the var- 
ious rating categories. With three degrees of 
freedom, a chi-square 7. 934 is significant be- 

5 percent level. 
а от оор with scale 3 coded highest, the 
expected frequencies for each rating, under the 
null hypothesis of no difference, were 2.94, 12.24, 
7.35, and 1. 47 for ratings of1- 1.5, 2 - 2.5, 
уи 5, and 4 - 5, respectively. A comparison 
of the expected frequencies withthe observed fre- 
quencies indicated that the greatest discrepancy 
was for the 1 - 1.5 rating. It was then hypothe- 
sized that being rated high, i. e. lor 1.5 was re- 
lated to having scale 3 coded highest of all the 
scales. The data меге rris in à 2 x 2 contin- 
gency table, Yates' correction^" for small expect- 


ed trequencies applied, and chi-square calculated. 
The value found was 5. 871 (see Table IX). With 
one degree of freedom, this value of chi-square 
is significant beyond the 2 percentlevel. Exam- 
ination of the data showed the relationship to be 
positive. 

For these data at least, there seems to be a 
potential relationship for femaleteachers between 
the occurrence of scale 3 (Hy) being coded high- 
est and a supervisory rating ofoutstanding. Much 
larger groups of teachers including many who 
have been rated outstanding are needed to estab- 
lish this relationship firmly. | 

Continued explorationof various relationships 
among the data tabulated as indicated above failed 
to reveal additional statistical significant rela- 
tionships. However, an examination of the rela- 
tive frequencies in the various categories did 
bring out some interesting relationships which 
will be pointed out. Although only eleven cases 
out of the total 147 female teachers had scale 
0 (Si) coded highest, only two oí these received 
Supervisory ratings of average or less. It would 
appear that an absenceof scale 0 (Si) coded high- 
est may be associated with average or below av- 
erage supervisory ratings. 

However, when one considers the small num- 
ber (eleven) in the group, it is apparent that this 
may be a false conclusion. When the group is en- 
larged to include all those who had scale 0 (Si) 
coded among the three highest scales (see Table 
II), the number is increased to thirty-one and the 
number receiving ratings of average or below 15 
increased to thirteen, whichis more than the pid 
pected frequency, This would seem to dispute La 
conclusion of relationshipbetweena lack of sc А 
0 (Si) being coded high and average or below àV 
erage Supervisory ratings. | өп 

The above is ап example of a fact that has pie 
obvious throughout the analysis of the data in t € 
Study, namely, that for studies of this pa 
very large groups, preferably in the thonan 
rather than the hundreds, are highly desira P 
Whereas normally a much smaller group i$ ws 
ple for a good investigation, studies of this Ш> 
necessitate a group large enough to provide ae 
ficient cases in each of the sub-groups after 
data have been broken down. | аје 

А similar examination of the group Жару Б 
1 (Pt) coded highest indicates а possible slight M 
lationship between scale 7 (Pt) coded highest he 
average or below supervisory ratings. When а 
relationship between Scale 7 (Pt) being eines 
among the three highest and supervisory га вві 
is investigated, Support is gained for this po^ ар 
bility, since the chi-square for this relation ad 
is 5. 254 (about the 16 percent level). АИ ће 
the evidence is not statistically significant ae 
commonly designated 5 percent level, analys di- 
the data for this study seems to give SOTA е not 
cation that high codings of scale 7 (Pt) 2 


TABLE II 


FREQUENCY OF SUPERVISORY RATINGS OF FEMALE ТЕА! 


CHERS WHO HAD VARIOUS MMPI 
SCALES CODED AMONG THE THRE 


E HIGHEST 
Scale Coded Among ма абы Hating Chi- 
the Three Highest 1-1,5 2-2,5 3-3.5 4-5 Square 
N = 147 18 15 45 9 В.Е. 23 
0 31 4 (3. 80) 14 (15. 82) 11 ( 9.49) 2 (1.90) 
1 14 2 (1.11) 8( 7.14) 4 ( 4.29) 0 (0. 86) 1. 198 
2 16 1 (1.96) 9 ( 8.16) 4 ( 4.90) 2 (0.98) 2.178 e 
3 54 9 (6. 61) 25 (27.55) 15 (16. 53) 5 (3. 31) . 774 2 
4 45 5 (5.51) 25 (22.96) 13 (13. 78) 2 (2. 76) . 691 2 
5 29 3 (3.55) 20 (14. 80) 6 ( 8.88) 0 (1. 78) 5. 761 
6 45 6 (5.51) 22 (22.96) 15 (13. 78) 2 (2. 76) 576 
7 62 4 (7.59) 32 (31. 63) 20 (18.98) 6 (3. 80) 5.254 
8 42 8 (5. 14) 24 (21. 43) 12 (12. 86) 3 (2. 57) 1. 862 
9 48 6 (5. 88) 25 (24. 49) 15 (14. 69) 2 (2.94) 474 
X 4 1 0 3 0 
*Number in parentheses following observed frequency is expected frequency for that cell. 
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TABLE III 


FREQUENCY OF SUPERVISORY RATINGS OF FEMALE TEACHERS WHO HAD VARIOUS MMPI 
SCALES CODED LOWEST OR TIED FOR LOWEST 


Scale Coded Low- Supervisory Rating 
est or Tied for Chi- ез 
Lowest 14,5 2-2.5 $58.5 4-5 Square 9 
№ = 147 18 15 45 9 D =3 2 
im 
0 21 3 (2. 57)* 13 (10.71) 3( 6. 43) 2 (1.29) 3. 248 © 
tj 
1 5 0 3 2 0 5 
2 16 3 (1. 96) 10 ( 8.16) 3 ( 4.90) 0 (0.98) 3. 009 Es 
S 
3 7 1 5 1 0 z 
У 
4 4 1 2 0 1 z 
ti 
5 4l 4 (5. 02) 17 (20. 92) 17 (12. 55) 3 (2.51) 3. 625 5 
Q 
6 7 0 3 4 0 > 
Е 
7 13 2 (1. 59) 3 ( 6.63) 8 ( 3.98) 0 (0. 80) 1. 626 e 
8 3 1 1 1 0 
9 11 1 (1. 35) 7 ( 5.61) 1, € 8:99) 2 (0. 67) 5. 091 
X 19 2 (2. 33) 11 (9. 69) 5 ( 5. 82) 1 (1. 16) . 413 


*Number in parentheses following observed frequency is expected frequency for that cell. 


FLANAGAN 337 


associated with high supervisory ratings for wom- 
еп teachers, but that low codings of scale 7 are 
associated with average or below supervisory 
ratings for women teachers (see Tables III, IV, VII 
апа IX). The codetype 7 - 5 (high coding of sev- 
en with low coding of 5) was a com mon one for 
women teachers in boththe above average and av- 
erage or below rated groups, the evidence again 
favoringthelower ratedteachers. Superior teach- 
ers did not, in general, make their highest MMPI 
Scores on scale 7 (see Tables I and II). 

_ Further examination of ће data revealed a pos- 
sible meaningful relationship between scale 5 (Mf) 
coded among the three highest and supervisory 
ratings. The chi-square value indicating the re- 
lationship was 5. 761 (about the 13 percent level). 
This was high enough to merit further investiga- 
tion (see Table II). 

The number inthe group which had scale 5 (Mf) 
Coded among the three highest was 29. The ex- 
ected frequencies for the four supervisory ratings 
from 1 to 5 were, respectively, 3.55, 14. 80, 
8.88, and 1.78. The largest discrepancy between 
expected and observed frequencies was for the 
group with ratings of 20r 2.5. When the chi- 
Square test was applied to the re-grouped data to 
test whether scale 5 being coded among the three 
highest might be related to a 2 or 2.5 rating, а 
Value of 4, 65 was obtained. If Yates’ correction 
for small expected frequencies is applied, the 
calculated chi-square value is 3.80 (see Table IX). 
With one degree of freedom, 3.80 just misses be- 
Ing significant at the 5 percent level. 

Тһе data for this same group were then ar- 
ranged in a 2 x 2 contingency table to test herien 

aving scale 5 (Mf) coded among the three highest 


COres might be related to ratings eo 


above average, that is, from 1 through 2.5. W 
is arrangement, Yates’ correction was nonen 
@ 


frequencies in each 
a chi-square of 4. 00 
significant be- 


е ^ 
мы Since the expected 
Ге above ten. This time 


Was fo erie 
und (see Table УП). This 15 · 
попа the 5 percent level, indicating that for the 


Тоир of women teachers in this study, a high cod- 
ag of scale 5 is positively related to shone avene 
On Ог outstanding supervisory ratings. T p " 
me indication that the rating is more apt to 
Tes than 1 or 1. 5. 
Scale еге is some indication К 
With 5 (Mf) for the women teat 
таң уегаве or below 4 i 
ngs (see Tables Ш, IV, УШ and УСО. ius 
ој Comparison of the freque ncies 0 је 
ар tations of high and low coded коа 
teat а н А т teacher ter ences: 
any statistically significant Т gail lo 


number in most categories У“ 


Я | m! - 
Mag “fe — will be found | 
agi, Cl'ences to Appendices У 


^ Wisconsin. 


w coding of 
ted 


be dependable (see Table VIII). An examination 
of the data, however, shows that for every code 
type with 5 low (0-5, 1-5, 2-5, 3-5, еіс.,) 
the expected frequency is larger thanthe observed 
frequency for the average or below average gioup. 

Since scale 5 coded low has been found to be 
either a suppressor or an intensifier factor with 
high codings of other scales?l, chi-square tests 
were run to see if a low coding of scale 5 witha 
high coding of each of the other scales differenti- 
ated between supervisory ratings above average 
and those below that. For the group of women 
teachers studied, no sigificant differences in su- 
pervisory ratings were found within the group 
with a particular scale coded high in respect to 
having scale 5 coded low or not coded low. Data 
for this analysis can be found in Table VI. 

A low coding of scale 2 (D) was associated with 
the group of women teachers stu died with above 
average or outstanding supervisory ratings (see 
Tables III, IV, and УП). When the supervisory 
ratings were divided into a dichotomy, a chi- 
square value at the 5 percent level was calculat- 
ed (see Table VII). Drake22 says that a low cod- 
ing of scale 2 for women is frequently related to 
‘socially outgoing characteristics". 

The proportion of the number in each super- 
visory rating category who had the various Scales 
coded highest or among the highest was also cal- 
culated and recorded as a percent (see Appendix 
B, Tables A and B).* Tabulations of other com- 
binations were also made (see Appendix B, Tables 
C, D, and Е). While some of the relationships 
shown in these tables may be of some interest, 
none of these supplementary tables indicate any- 
thing of statistical significance. 


The Male Teachers 
The Мате "A 


The number of male teachers in the group 
studied was 50 small (twenty) that little could be 
done of а statistical nature. Whenthe available 
data were broken down into the necessary sub- 
groups, the number in each group was usually 
zero or one and seldom more than two. Descrip- 
tive stateme nts concerning this group of male 
teachers will be made аз far as seems appro- 


priate. 


Two of the twenty men inthe group received 


supervisory ratings of 1. 5; thirteen of the group 
were rated 2; one was r ated 2.5, and four were 
rated 3. Thus, sixteen of the twenty men in the 
group were rated above average or outstanding by 
their supervisors or principals. Тће other four 
were rated average. With numbers this small, 
tements of relations hips between super- 


any sta 
tings and MMPI code types could not be 


visory га 


ile, Library, University of Wisconsin, 


TABLE IV 


866 


FREQUENCY OF SUPERVISORY RATINGS OF FEMALE TEACHERS WHO HAD VARIOUS MMPI 


SCALES CODED AMONG THE TWO LOWEST 


Supervisory Rating 


Scale Coded Among Chi- 

the Two Lowest 1-1.5 2: = 2.5 3-35 4-5 Square 5 
N = 147 18 75 45 9 Р.Е. =3 Е 
0 36 4 (4. 41) 20 (18. 37) 9 (11. 02) 3 (2. 20) 1.113 Б 
1 22 3 (2. 69) 12 (11.22) 6 ( 6. 73) 1 (1. 35) · 303 Б 
2 32 5 (3.92) 20 (16. 33) 6 ( 9.80) 1 (1. 96) 3.919 5 
3 14 1 (1. 71) 8(7.14) 5 ( 4.29) 0 (0. 86) 1.522 8 
4 16 2 (1.96) 7 ( 8.16) 6 ( 4. 90) 1 (0. 98) 466 5 
5 50 5 (6. 12) 22 (25.51) 18 (15. 31) 5 (3. 06) 3. 623 г 
6 15 2 (1. 84) 7 ( 7.65) 6 ( 4.59) 0 (0. 92) 1.582 а 
7 27 5 (3.31) 11 (13. 78) 11 ( 8.27) 0 (1. 65) 4. 882 5 
8 10 2 (1.22) 4( 5.10) 4 ( 3.06) 0 (0. 61) 1. 764 = 
9 23 4 (2. 82) 13 (11. 73) 4 ( 7.04) 2 (1. 41) 2. 603 
X 19 2 (2. 33) 11 ( 9.69) 5 ( 5.82) 1 (1.16) . 413 


*Number in parentheses following observed frequency is expected frequency for that cell. 
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TABLE V 


FREQUENCY OF SUPERVISORY RATINGS OF FEMALE TEACHERS WHO HAD VARIOUS PAIRS 
OF MMPI SCALES CODED AMONG THE THREE HIGHEST 


Pairs of Scales 


попе the Supervisory Rating ci 
Three Highest 1-15 2,42. 5 3-3.5 4-5 Square 
N - 147 18 15 45 9 D.F. =3 
01 4 1 1 2 0 
02 5 1 1 5 1 
03 1 1 4 1 1 
04 4 1 3 0 0 
05 3 1 1 1 0 
06 8 1 3 4 0 
07 21 2 (2.57)* 9 (10. 71) 8 (6. 43) 2 (1.29) 1.379 
08 11 0 (1. 35) 1( 5.61) 4 (8. 31) 0 (0. 67) 2. 683 
09 2 0 0 2 0 
ох 0 0 0 0 0 
12 1 0 1 0 0 
13 8 2 4 2 5 
0 
14 3 0 i У 
0 0 
15 1 0 1 
0 0 
16 2 0 2 
1 0 
11 4 0 3 
0 0 
18 1 0 T 
1 о 
19 5 1 s 
0 
IX 0 0 В j 
| 0 
23 4 0 ш 
0 0 
24 5 1 * 
1 0 ш 
25 1 0 
$ 1 0 
26 2 0 8 
3 
27 10 0 5 
3 s 1 
28 5 0 
0 1 ы 
29 1 0 5 
2х 0 0 d | 
7. 65) 5 (4.59) 2 (0. 92) 1. 873 
34 15 2 (1. 84) 6( 7 ó 
2 
35 9 1 6 
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TABLE V (Continued) 


Pairs of Scales Supervisory Rating 


Among the Chi- 
Three Highest 1-1.5 2-2.5 3-3.5 4-5 Square 
N - 147 18 75 45 9 D.F. -3 
36 19 2 (2.33) 10 ( 9.69) 6 (5. 82) 1 (1. 16) . 097 
37 п 0 (1. 35) 6 ( 5.61) 2 (3. 37) 3 (0. 67) 10. 772 
38 6 0 3 2 1 
39 15 3 (1. 84) 6 ( 7. 65) 5 (4.59) 1 (0. 92) 1. 267 
3x 5 1 2 2 0 
45 5 0 4 1 0 
46 11 2 (1.35) 5 ( 5.61) 4 (3. 37) 0 (0. 67) 1.271 
4T 20 1 (2.45) 11 (10. 20) 7 (6.12) 1 (1.22) 1.257 
48 10 0 6 4 0 
49 16 2 (1.96) 10 ( 8.16) 4 (4. 90) 0 (0. 98) 1. 749 
4X 0 о о 0 0 
56 6 0 4 2 0 
51 4 1 1 2 0 
58 2 0 2 0 0 
59 11 0 (1. 35) 9 ( 5.61) 2 (3. 37) 0 (0. 67) . 499 
5X 5 1 3 1 0 
67 19 2 (2. 33) 9 ( 9. 69) 8 (5.82) 0 (1.16) 2. 387 
68 11 2 (1. 35) 5 ( 5.61) 4 (3. 37) 0 (0. 67) 1.271 
69 8 2 2 3 1 
6x 2 0 1 0 1 
18 31 2 (3. 80) 17 (15. 82) 9 (9. 49) 3 (1. 90) 2. 032 
79 15 145,83) 9 ( 7. 65) 4 (4. 59) 1 (0. 92) ‚182 
TX 0 0 0 0 0 
89 13 2 (1.59) 7 ( 6.63) 3 (3.98) 1 (0. 80) ‚459 
8x 0 0 0 0 0 
9x 4 0 1 3 0 


а давање == —— 


*Number in parentheses following observed frequency is expected frequency for that cell. 
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TABLE VI 


FREQUENCIES OF PRESENCE OR ABSENCE OF LOW CODING OF SCALE 
5(Mf) WITH HIGH CODING OF OTHER SCALES FOR FEMALE TEACHERS 
WITH ABOVE AVERAGE OR SUPERIOR AND AVERAGE OR BELOW 
SUPERVISORY RATINGS 


Supervisory Rating 


Code Type* 1 - 2.5 3-5 Chi-Square 
High - Low N = 93 N=54 D.F. =1 
0-5 6 7 
0 - Not 5 12 6 1. 304 
3-5 8 д 
3 - Not 5 26 13 826 
4-5 10 8 
4 - Not 5 20 Т 1. 667 
6-5 12 1 
6 - Not 5 16 10 “001 
1-5 16 5 
1.0 

7 - Not 5 20 11 60 
8-5 10 8 

1 1. 046 
8 - Not 5 17 

7 
9-5 7 

10 1.838 
9 - Not 5 24 

5, when coded low 


*High coded scale was among the three highest; 
Was among the two lowest. 
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TABLE VII 


Supervisory Rating 


1-2.5 3-5 Chi-Square 
Code Type N - 93 N = 54 D.F. =1 
0 highest 9 ( 6.96)* 2 ( 4.04) 1. 760 
3 18 (15. 18) 6 ( 8.82) 1. 704 
4 6 ( 6.96) 5 ( 4.04) .956 
5 14 (11. 39) 4 ( 6. 61) 1. 869 
6 11 (11. 39) 7 ( 6.61) 
7 17 (18. 98) 13 (11. 02) . 707 
9 20 (18. 98) 13 (11. 02) .188 
0 among 3 highest 18 (19. 61) 13 (11. 39) . 460 
1 10 ( 8. 86) 4 ( 5.14) . 442 
2 10 (10. 12) 6 ( 5.88) 
3 34 (34.16) 20 (19. 84) 
4 30 (28. 47) 15 (16. 53) . 323 
5 23 (18. 35) 6 (10. 65) 4. 002 
6 28 (28. 47) 17 (16. 53) 
7 36 (39. 22) 26 (22. 78) 1. 245 
8 21 (26. 57) 15 (15. 43) 
9 31 (30. 37) 17 (17. 63) 
0 lowest 16 (13. 28) 5 ( 7.72) 1. 761 
2 13 (10. 12) 3 ( 5.88) 2. 499 
5 21 (25.94) 20 (15. 06) 3.550 
7 5 ( 8.22) 8 ( 4. 78) 3. 775** 
9 8 ( 6. 96) 3 (4. 04) . 458 
2 among 2 lowest 25 (20. 25) 7 (11. 75) 3. 886 
5 27 (31. 63) 23 (18. 37) 2. 799 
7 16 (17. 09) 11 ( 9.91) .228 
9 17 (14.55) 6 ( 8.45) 1. 330 
07 among 3 highest 11 (13.28) 10(7 72) 1.249 
34 among 3 highest 8 ( 9.49) 7 ( 5.51) . 709 
37 6 ( 6. 96) 5 ( 4.04) . 389 
49 12 (10. 12) 4 ( 5. 88) 1. 066 
67 11 (12. 02) 8 ( 6.98) 2271 
78 19 (19. 62) 12 (11. 38) . 066 
89 9 ( 8.23) 4(4 77) 215 
* Numbers following observed fre 


applied. 
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TABLE VIII 


COMPARISON OF FEMALE TEACHERS RATED ABOVE AVERAGE OR SUPERIOR WITH THOSE 
RATED AVERAGE OR BELOW AS TO COMBINATIONS OF HIGH AND LOW CODED SCALES 


Code Type Above Frequency Below Frequency Chi-Square 
High with Low Observed (Expected) Observed (Expected) ТЕ. = 
0-1 4 ( 3. 80) 2 ( 2.20) 
0-2 3 1 
0-3 5 ( 5.06) 3 ( 2.94) 
0-4 1 1 
0-5 6 ( 8.23) 7 ( 4.77) 1. 8064 
о 
0-7 
0 0 
$ ч 1 ( 6.96) 4 ( 4.04) 
0-X 3 ( 2.53) : ( 1.47) 
1-0 1 9 
1.2 3 | 
7 0 : 
1-2 2 2 (1.47) 
1-5 2 ( 2.53) : | 
1-6 1 0 
leg 1 ô 
1-8 0 1 
1-9 3 і 
1-Х 2 С 
2-0 2 ў 
2-1 р 1 
55% 0 
E ШЕ { ои 
2-8 1 0 
дат 0 0 
2-8 : 2 
2-9 0 
2x 3 12. 65) 9 ( 7. 35) . 6779 
3-0 п qur 1 ( 1.84) 
Ж. 4 b 1 ( 2:94) 
3-2 1 ` 2 
Bin id 3 ( 9.49) 1 ( 5.51) . 1092 
ie 2 5 ( 4.77) 5495 
3-6 6 i à 
3-1 т (iam NEU 
32% T ( E 3 ( 2.94) 
з-х 5 (596 4 (40) 
зе І 1 ( 2.20) 
a 5 ( 3. 80) 1 ( 1.84) 
pi 4 ( 3. 16) 8 ( 6.61) ‚5264 
4-3 (11. 39) 
4-5 10 1 
4-6 2 1 
5 2 
4-7 
0 1 
4-1 3 2 ( 2.94) 
de- 6 ( 5.06) 2 ( 3.67) . 2881 
4-х 33) 
5 8 (6. 1 ( 2.94) 
8.1 1 ile 4 ( 4.04) 
5.2 7 (6 0 
5-3 2 3 
Вън 4 3 ( 4.04) ‚ 4561 
5-6 д ( 6. 96) 
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TABLE VIII (Continued) 


Code Type Above Frequency Below Frequency Chi-Square 
High with Low Observed (Expected) Observed (Expected) DE, zi 
5-8 2 0 
5-9 5 0 
5-3 1 0 
6-0 7 ( 5.69) 2 (3:30) 
6-1 4 i 
6-2 7 ( 5.06) 1 ( 2.94) 
6-3 2 0 
6-4 4 4 
65 12 (12. 02) 7 ( 6.98) 
6-7 5 3 
6-8 2 1 
6-9 8 ( 6.96) 3 ( 4.04) . 4561 
6-X 2 2 
7-0 3 2 
Ты 3 2 
Ла 9 8 ( 6.33) 2 ( 3.67) 1.2881 
7-39 6 3 
7-4 2 0 
Tab 16 (19. 61) 15 (11. 39) 2. 2922 
7-6 1 3 
7-8 0 1 
T 6 ( 5.69) 3 ( 3.31) 
T-X 6 ( 6. 33) 4 ( 3.67) 
8-0 4 1 
8-1 2 0 
8-2 6 ( 4.43) 1 ( 2.57) 
8-3 3 2 
8-4 0 0 
8-5 10 (11. 39) 8 
Hn м : ( 6.61) ‚5264 
8-7 1 0 
8-9 2 1. 
Bin d 5 ( 5.06) 3 9. 
9-0 13 (11. 39) 5 | 6. sn 5264 
922 ТЕ ШЕН. | 
= . 86 
iar A (5.14) ‚4415 
9-4 2 1 
"Ји д 4 ( 8.86) Г ( 5.14) 1.1755 
a i 1 ( 8.86) I ( 5.14) 1.1755 
9-х 6 ( 5.06) 
Fe 4 : ( 2.94) 
Ж= 1 0 1 
3-5 1 0 
Rel 0 1 
х=й 0 2 
* Б 0 0 
X-6 0 2 
X-7 1 0 
х-8 р 1 
х-9 0 0 


: Number rated above average - 93 (63. 27%) 
Note: Li. rated average or below - 54 (36. 73%) 
High coded scale was among the three highest. 

Low coded scale was among the two lowest. 
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TABLE IX 


FREQUENCY RELATIONSHIPS AMONG MISCELLANEOUS CODE TYPES AND SUPERVISORY 


RATING CATEGORIES FOR FEMALE TEACHERS 


Rating Chi-Square 
Code Type 1-1.5 Below 1.5 Di Bad 
3 highest 1 17 
3 not highest 11 112 7. 643 
5. 871 with Yates' Correction 
7 highest l 29 
7 not highest 17 100 2. 186 
3 among 3 highest 9 45 
3 not among highest 9 84 1.556 
7 among 3 highest 4 58 
қ 3. 349 
7 not among highest 14 71 И ізде Ез ЕЗНЕН 
8 among 3 highest 3 39 
8 not among highest 15 90 1.424 
47 among 3 highest 1 19 
47 not among highest 17 110 1.131 
78 among 3 highest 2 29 
" l: 
78 not among highest 16 100 227 
22 
7 among 2 lowest 5 
107 1.211 
7 not among lowest 13 
2-2.5 Not 2 - 2.5 
9 
5 among 3 highest 20 T 
5 not among highest 55 63 3. 80 with Yates' Correction 
423.5 Not 3 - 3.5 
24 
5 lowest 17 
78 3. 152 
5 not lowest 28 
д8 Not 4 - 5 
56 
7 among 3 highest g 
Е e 82 2. 349 
3 
7 not among highest 
27 
Я annus Bt 0 2.157 
among 2 lowest т 
tid о 
à == 
е 


7 not among lowest Ен 
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TABLE X 


RS WHO HAD VARIOUS 
MMPI SCALES CODED HIGHEST OR TIED FOR HIGHEST 


Scale Coded High- 


Supervisory Rating 


est or Tied for 1.5 2. 2.5 Ка Total 
Highest N=2 N=13 N=1 N=4 N = 20 

0 0 0 0 0 0 

1 0 1 0 0 1 

2 0 1 0 0 1 

3 0 2 0 0 2 

4 0 0 0 1 5 

5 2 5 0 2 9 

6 1 2 0 0 3 

7 1 2 0 1 4 

8 0 0 0 0 0 

9 0 1 1 0 2 

TABLE XI 


FREQUENCY OF SUPERVISORY RATINGS OF M 


ALE TEACHERS WHO HAD VARIOUS 


MMPI SCALES CODED AMONG THE THREE HIGHEST 


m Supervisory Pat ing 
Fighest Eh. ==. Total 
0 0 2 0 0 2 
1 0 2 1 о 3 
2 0 3 0 2 5 
3 1 5 1 0 7 
E 0 2 0 2 4 
5 2 7 2 2 13 
6 1 4 0 0 5 
1 1 3 0 2 6 
8 1 4 1 1 7 
9 1 1 1 1 4 
х 0 0 0 0 0 
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TABLE XII 


FREQUENCY OF SUPERVISORY RATINGS OF MALE TEACHERS WHO HAD VARIOUS 
MMPI SCALES CODED LOWEST OR TIED FOR LOWEST 


кө Сай e Supervisory Rating 
Lowest 1.5 2 2.5 3 Total 
0 1 2 о о 3 
1 0 1 0 1 2 
2 0 0 0 1 1 
3 0 1 0 0 1 
4 0 1 0 0 1 
5 0 0 0 1 1 
6 0 1 0 0 1 
7 0 2 0 0 2 
8 0 2 0 0 2 
9 0 1 0 0 1 
x 1 2 1 1 5 
TABLE XIII 


RIOUS 
RATINGS OF MALE TEACHERS WHO HAD VA 
ad AMONG THE TWO LOWEST 


OF SUPER 
FREQUENCY MMPI SCALES CODED 


SOO " 
Supervisory Rating 
Scale Coded 
Among the Two 5 2 2.5 3 Total 
Lowest 1. 
0 1 7 
0 р В 
5 0 1 6 
1 0 
0 0 1 
1 
0 
+ 0 0 1 
1 
0 
3 0 0 4 
1 3 
4 0 1 2 
0 1 
5 0 0 0 
0 0 
6 4 0 0 4 
7 0 0 0 5 
0 5 
8 0 2 
0 d | 
9 1 1 5 
2 


347 


348 


FREQUENCY OF SUPERVISORY RATINGS ОЕ 
MMPI SCALES CODED A 


JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE XIV 


MALE TEACHERS WHO HAD VARIOUS PAIRS OF 


MONG THE THREE HIGHEST 


Pairs of Scales 
Coded Among the 
Three Highest 


01 
02 
03 
04 
05 
06 
07 
08 
09 
ох 
12 
13 
14 
15 
16 
17 
18 
19 
1х 
23 
24 
25 
26 
27 
28 
29 


2х 


1.5 


Supervisory Rating 


2 


2.5 Total 

0 0 0 
0 0 0 
0 0 0 
0 0 0 
1 0 1 
0 0 0 
1 0 1 
2 0 2 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
3 0 3 
0 0 0 
1 0 1 
2 0 2 
0 0 0 
0 0 0 
2 0 2 
0 0 1 
2 0 3 
2 0 2 
0 0 1 
0 0 1 
0 0 0 
0 0 


a G NET 


— M 


FLANAGAN 


TABLE XIV (Continued) 


ене Supervisory Rating 
Three Highest 1.5 2 2.5 3 Total 
34 0 1 0 0 1 
35 1 2 1 0 4 
36 1 1 0 0 2 
37 0 0 0 0 0 
38 0 0 0 0 0 
39 1 1 1 0 0 
3x 0 0 0 0 0 
45 0 0 0 1 1 
46 0 1 0 0 1 
41 0 1 0 1 2 
48 0 0 0 0 0 
49 0 0 0 1 1 
- 0 0 0 0 0 
56 1 2 о 0 3 
57 1 1 0 0 2 
58 1 Е 3 s 
59 1 ы i i à 
5x 0 0 ° қ " 
" 6 1 0 0 1 
» 5 1 0 0 1 
69 1 d ° | 
6x a к | ° ° 
78 i | и | : 
"9 0 у : i | 
и p б 0 0 0 
е к 0 0 0 0 
8х 5 И | | я 
9х 9 ? р ° а 
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depended upon. The addition of one or two more 
cases could change the picture entirely in many 
of the categories. 

It can be noted that nine of the twenty men had 
scale 5 (Mf) coded highest of а11 the scales (see 
Table X), and thirteen of the twenty had scale 5 
coded among the three nighest (Table XI). Only 
two men had a low coding of scale 5 (see Table 
ХШ). Drake23 says, “А high coding of this scale 
among men is particularly frequent in an educa- 
tional setting. ”’ 

No other scale was coded highest frequently 
enough to merit special attention. Scale 3 (Hy) 
was coded among the three highest seven times, 
all for above average teachers. Scale 7 (Pt) was 
coded among the three highest six times, two of 
these being for men whowere rated average teach- 
ers. Scale 8 (Sc) was among the three highest 
scales seven times, distributed among the rating 
categories. 

No pair of scales was coded among the highest 
three scales frequent ly enough to warrant any 
generalizations concerning it (see Table XIV). 
Pairs 15, 25, 39, 56, and78 appeared three times 
each. Pair 35 was coded among the three highest 
four times and 58 was coded among the three 
highest five times. Four of these times were for 
teachers with supervisory ratings of 2 and the 
other was for a teacher with a rating of 1.5. 

Five of the twenty men in the group had no 
scales coded low (more than one standard devia- 
tion below the mean), These five appeared in all 
four of the supervisory rating categories (see Ta- 
ble XII). Three ofthe group had scale 0 (Si) coded 
lowest and two each had scales 1 (Hs), 7 (Pt), апа 
8 (Sc) coded lowest. 

Six of the men had scale 0 (Si) coded among the 
two lowest scales. A low coding of scale 0 for 
men is ‘‘probably indicative of an adequate social 
adjustment. "24 Five each had scales 1 (Hs) and 
8 (Sc) coded among the two lowest. Four men 
each had scales 4 (Pd) and " (Pt) coded among the 
two lowest. 

Because many of the sub-groups in this study 
(for both men and women) were very Small, it was 
thought that Fisher's exact probability test might 
be helpful. Siegel25 states, “Тһе Fisher exact 
probability test is an ext remely useful nonpara- 
metric technique for analyzing discrete data 
(either nominal or ordinal) when tne two inde- 
pendent groups are smallin size and when the 
scores from the two groups fall intGvOue or the 
other of two mutually exclusive classes. The de- 
termining of the exact probabilities by means of 
Fisher’s formula is rat her laborious, but many 
of the values may be obtained froma ae 
Critical Values of Dinthe Fisher- Yates Test. ' 
The Fisher test did not add any new information 
for this study; but itdid support some of the pre- 
: ined relationships. 
viously determine 


Summary 


In summary, it can be stated that the analysis 
of the data for this study indicates tie following 
relationships, —all of whichare limitedto the pop- 
ulation studied or a similar group: 


1. A high coding of scale 3 (Hy) for women 
teachers was positively related toa supervisory 
rating of outstanding. Althougha statement of 
this relationship does not appear in any of tne lit- 
erature, Professor L. E. Drake, Head of the Stu- 
dent Counseling Center of the University of Wis- 
consin, has statedorally that in his experience he 
has found such a relationship to exist. 

Thirty-five percent of the small group of men 
in the study had scale 3 (Hy) coded among the three 
highest scales. All of these men were rated 
above average or outstanding by supervisors. 

2. Scale 7 (Pt), altho ugh coded highest or 
among the three highest scales for women teach- 
ers more frequently than any other scale, did not 
distinguish to a marked degree between good and 
poor teachersas indicated by supervisory ratings. 

An absence of scale 7 coded high seemed to be 
somewhat related to high supervisory ratings for 
women teachers. 

Low codings of Scale 7 appeared to be positive- 
ly related to low supervisory ratings for women. 

Scale 7 was not coded high for men as fre- 
quently, relatively Speaking, as for women teach- 
ers. It was coded among the lowest two scales 
more frequently for men than were many of the 
other scales, 

3. For the women teachers in this study, 4 
high coding of scale 5 (Mf) was positively related 
to supervisory ratings which were above average, 
whereas a low coding of this scale seemed to be 
somewhat related to average or below supervis- 
ory ratings. There аге some indications that more 
extensive data might reveal more definite rela- 
tions between high or low codings of scale 5 and 
supervisory ratings. It can be noted that in the 
lowest rated group of female teachers, there 15 
no occurrence of scale 5 coded high. 

For male teachers, scale 5 (Mf) coded highest 
appeared in 45 percent of the cases. It was coded 
among the three highest scales in 65 percent pi 
the cases. Only one man had scale 5 coded among 
the two lowest Scales. 

4. А low coding of scale 2 (D) for women Кенет 
ers Was associated with supervisory ratings thà 
were above average. а 

5. Scale 0 (Si) was coded lowest much едм 
frequently than it was coded highest for wome 
teachers. A low coding seemed to be somewh? 
related to above average supervisory ratings. | 

Scales 2 (D) апа 5 (Mf) were also coded Јоже 
more frequently than highest Гог women. je 

here were only four out of 147 fem 


ој — 2 əр. 
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teachers who had no scales coded low, whereas 
five of the twenty male teachers had no scale 
coded low. 

It was pointed out in an earlier section that 
the MMPI was originally designed for and stand- 
ardized on mental patients, but that it has since 
been used advantageously on many different more 
normal groups in a variety of situations. 

It should be pointed out that the people in this 
Study, who were given the MMPI, were all Univer- 
Sity of Wisconsin graduates who were granted a 
certificate to teach. The University of Wisconsin 
maintains an extensive testing, counseling, and 
guidance program and it is more than likely that 
most of the students with serious personality ab- 
normalities who were not eliminated through the 
natural processes associated with attending col- 
lege would be eliminated through the testing and 
counseling program. Atthe University of Wiscon- 
Sin, students who deviate seriously fromthe nor- 
mal are sent to the University psychiatrist for 
counseling or treatment. | | 

Apparently the University of Wisconsin pro- 
gram is effective in eliminating the serious per- 
Sonality cases before they are graduated and sent 
Out to teach. For the 167 cases in this study, 
there were only two reports from supervisors “т 
Principals which were concerned with emotiona 
instability which was serious enough to affect the 
teacher's work. If the University's program 15 
Successful, one would not expect the MMPI to a 
Cover many extreme de viations from погташу 
àmong the group in this study. 

The MMPI may be a valuabl 
helping ю eliminate the occasion 
Viated personality that does graduat 


teaching position. is rec- 
om 3а experimentation with the MMPI is Гес. 
ommended to see if there isn't some 0 (8) 5 
Point on certain scales, possibly dap ales, a 
f), and 7 (Pt), or on combinations 9 e: from 
Score beyond which would eliminate а ==: 3 points 
teacher candidacy. In order to findsuc а cón- 
specially if combinations ofscales m я 
Sidereq, it would probably be necessary puerto 
Оп à study of several years gre ae 
et enough individuals in the study. | 5 [requently 
One serious deficiency or fault ul Success 
enough to make a person unsuccessful. ЭЧ 
Шау be due to опе or more superiorii te super- 
116 а serious deficiency does not oian rities. 
^T qualities, or to a number of pes been re- 
he various scales of the MMPI h number and 
“red to frequently by number ОГ ay t that the 
BD Бета ion. It has been pointed ou sc with 
rales were first developed for petere of 
Spital patients and they bear pola" se of the 
“Viate behavior. Withthe incr d further in- 
egi OTY for more normal peo = ation o 
on tigation in regard to the interpres, Inventory 
е various scales, the authors ° 


e instrument in 
al seriously de- 
e and seek a 


have suggested that the clinical titles and descrip- 
tions of the various scales should probably not be 
used. They suggest calling the scales by number 
or letter. This has been done throughout this re- 
port. 

However, for those who are not familiar with 
the MMPI, brief descriptions of the various scales 
will be given. This will be done primarily in the 
language of Drake27 who describes the scales in 
terms of the behavior of more normal persons. 

Scale 0 (Si) has the title “Social Introversion- 
Extroversion". This scale was derived and 
cross-validated by Drake28,29, Из title ismore 
ог less self explanatory. The scale is intended 
to measure a characteristic that is thought to be 
important in college adjustment. Personality 
patterns with a high coding of scale 0 (Si) have 
been found among persons showing introvertive 
characteristics, especially shyness, social inse- 
curity, and social withdrawal. One might expect 
sucha personality characteristic to be detri- 
mental to teaching success. Оп the other hand, 
a low coding of scale 0 (Si), which is probably 
indicative of an adequate social adjustment, may 
indicate a higher degree of teacher effectiveness. 
The present study found low codings of scale 0 
(Si) for women teachers was associated with 
above average supervisory ratings. 

Scale 1 (Hy) bears the name “Ну poc hondri- 
asis’’. Elevationof this scale appeared relative- 
ly infrequently with college men and women, prob- 
ably because persons with problems of a nature 
which caused a high coding of this scale sought 
medical aid. A high coding of this scale in a 
teacher's profile might indicate trouble which 
needs medical treatment. 

The “Тергеввіоп” scale has the number 2. А 
high score on scale 2 (D) is indicative of unhap- 
piness and depression. This condition may be 
associated with problems in the area of human 
relations, lack of success in a chosen endeavor, 
or dissatisfaction withsome aspect of the imme- 
diate environment. Scale 2 coded low with wom- 
en were relatedto extroversionor socially outgo- 
ing characteristics. The study here reported 
found low codings of scale 2 were associated with 
above average supervisory ratings for women. 

The operation of scale 3, **Hysteria" (Hy), 
with college students appeared to be different 
than with the patients upon whom it was derived. 
For normal college people, scale 3 coded high 
appears to be indicative of a lack of social prob- 
lems. Scale 3 coded high along with certain other 
scales seems to indicate a variety of tendencies, 
but in most of them, a good general adjustment 
seems prevalent. This should contribute to a 
high degree of teacher effectiveness. The find- 
ings of the present study were that such a rela- 
i ip exists. 

Е асорат Deviate” scale, number 4 
(Pd), seemed to have little to do with college ed- 
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ucated people. Probably persons who are psycho- 
pathic deviates get intotrouble and are eliminated. 
Elevation of this scale is associated with delin- 
guency. There is some evidence that Scale 4, in 
combination withother Scales, often is associated 
with antagonism to authority, aggressive behav- 
ior, and conflict situations when it is elevated in 
a man's profile. With women this aggressiveness 
seems to be expressed in home conflict or in so- 
cially outgoing behavior depending upon the rest 
of the profile. 

Scale 5 (Mf) was theleast well validated of the 
basic scales on the MMPI. It bears the title 
** Masculinity- Femininity” and was de signed to 
assist inthe identification of homosexuals. How- 
ever, the scale failed to distinguish between the 
homosexual groupand normals. A high coding of 
this scale among men is particularly frequent in 
an educational Setting. Itisa complicated scale 
to interpret, but it is one of the most valuable 
Scales in co unseling students. An elevation of 
Scale 5 means different things, depending upon 
what other scales are ele vated with it. А low 
coding of scale 5 for Women was very common. 
This corresponds to a high coding for men. In 
many cases a low coding of 5 acted as a suppres- 
sor variable for behavior which is suggested by 
the rest of the profile, In some patterns it ap- 
pears to intensify or Support the rest of the pro- 
file. Ahigh coding of scale 5 with women appears 
to be associated with socially outgoing behavior. 
This should contribute to teacher effectiveness, 

A high coding of scale 6, "Paranoid", seems 
to occur infrequently with college men except when 
paired with scale 4, ““Psychopathic Deviate", In 
this case, it differentiated the anxiety Sub-group. 
High coding of scale 6 (Pa) may be an indicator of 
personal sensitivity and perhaps extreme concern 
about the reactions of others to something per- 
ceived by the counseleeasa deficiency. With 
teachers a high coding of scale 6 may indicate a 
person who is overly sensitive to the reactions 
of fellow teachers or even to students. 

Scale 7 (Pt) bears the name “*Psychasthenia”’, 
A high coding of scale 7 appears to be related to 
general anxiety states. A low coding with men 
probably indicates good adjustment. With women 

a high coding of scale Talso Suggests a feeling of 
insecurity. In general, high codings of this scale 
suggest personal problems, insecurity, state of 
anxiety, physical com plaints—none of which are 

ducive to good teaching and personal relation- 
СЕВ The present study found an absence of 
Boda d coded high was somewhat related to high 

і atings. 

Е о алаан, when coded high, 

eroi Main mental disorganization, vague 
frequ king motivation, general confused state. 
goals, lac и to be more serious with women 
This е. қаған It would seem that conditions as- 
nist with scale 8 (Sc) are a hindrance to ef- 


fective teaching. 

The **Hypomania" scale, number 9 (Ma), when 
coded high, appeared to indicate aggressiveness 
or belligerence in men and energetic action of a 
more socially approved nature in women. The 
high coding seemed to be modified cons iderably 
depending upon which scales were coded with it. 
For example, a high coding of scale 0 (Si) with а 
high coding of 9 was associated with social shy- 
ness, but when O (Si) was low with 9 high, social- 
ly outgoing and verbal behavior was suggested. 
Low codings of scale 9 (Ma) for women were us- 
ually indicative of social shyness wheneither scale 
0 (Si) or scale 2 (D) was coded low. In general, 
the type of personality to be expected in a teach- 
er with scale 9 coded either high or low seems to 
depend upon what Scales areassociated with it 
and in what manner they are related. 

It should be emphasized that it is dangerous [0 
associate the clinical names of most of these 
Scales with individuals who may possessa high 
ог low score on them. Perhaps new scales with 
new names should be developed for use when nor- 
mal persons are being studied 


SECTION Iv 


Summary and Conclusions 


Statement of the Problem 


The purpose of this stu dy was to investigate 
the relationship, if апу, between scores and рго- 
file patterns on the MMPIand success in teaching 
as indicated by Supervisory ratings. Personality 
has been considered by many to be an important 
factor in a teacher's Success. The many aspects 
of personality are combined ina multitude of ways 
to make people react differently to various situa- 
Чопз. Itis thought that some assessment of the 
different aspects of a teacher's personality may 
be helpful in predicting that person's success s 
failure as а teacher. This Study was an attemp 
to discover whether or not there were relation- 
ships between aspects of a teacher’s personality 
and his professional success. 


Subjects and Instruments 


a о 
This study was соп cerned with students ма“ 
were enrolled as freshmen at the Univer sity 


consin. One 


а z = 
stituted this Population. Only twenty of these ре 
Sons were males. 


: e 
, Supervisory ratings were obtained for не 
Individuals py Submitting a letter and a га 
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blank to the superintendents, principals, and su- 
pervisors of the schools in which they taught. 

Measures of tne various phases of tne teacher's 
personality were obtained from the results of the 
&roup form of the MMPI which had been given to 
the subjects when they were freshmen. The 
Scores had been coded accordingto a plan recom- 
mended by one of the authors of tne Inventory. 
The MMPI is a widely used instrument that has 
been found valuable in clinical studies. It is im- 
portant that its value for this particular purpose 
Should be ascertained. 


Method Employed 


Although several different statistical tech- 
niques were tried with the data of this study, the 
Chi-square test seemed the most appropriate and 
Provided the best analysis. For purposes of in- 
Vestigation the null hypothesis that teachers with 
different personality profiles would not differ in 
their supervisory ratings was established. The 
chi-square technique was used to determine if any 
Particular sub-group differed from the whole pop- 
ulation or from certain other sub-groups in re- 
Spect to supervisory ratings. Since this was not 
а sampling study, no generalizations to a larger 
group could be made, but the findings could be 
useful in predicting the success of future classes 
Ofteachers if one were willing to consider the 
Populationofthis study as a sample of the popula- 
tion of future teachers, orthat conditions will re- 
Main basically constant. 

Comparisons of frequencies, 
Other aspects of the data which : 
Were also made. Since the number of males in 
he Study was small and it is generally conceded 

hat males differ from females in their person- 
ality patterns, the analysis of the data for the 
male teachers was made separately. This was 
limiteq to the type of descriptive analysis men- 
tioned at the beginning of this paragraph. 


percentages and 
seemed pertinent 


Findings 
The findings of this study briefly summarized 
ere: 


l. There were differences in personality pat- 
{егиз among female teachers with different Т. 
“180гу ratings. A high coding of scale 3 (Hy) ^a 
та пеп was positively related to а E лан 
al Ae Of outstanding effectiveness. gen e ees 

50 coded high very frequently for male teac m 
"t the number of males was too small to m 

ПУ conclusions regarding the relationship. TAM 
2. Scale 5 (МЇ) seems to be positively c 


rated to supervisory ratings for women и a 

icang dings in this respect € р wh три 
сы, " 

Statistically. Scale 5 со ils persi- 


oS frequently noted aspect of the 


ality profiles. It was coded among the highest 
three scales 65 percent of the time. 

3. There appears tobe an inverse relationship 
between scale 2 (D) and supervisory ratings for 
women teachers. 

4. Scales 0 (Si), 2 (D), and 5 (Mf) were coded 
lowest more frequently than they were coded 
highest for the women teachers. 

5. Women teachers tended to have scales 
coded low more frequently than men teachers. 


Conclusions 


If one wishes to consider the group here studied 
as representative offuture groups of prospective 
teachers, one might conclude that the MMPI has 
good possibilities for helping in the prediction of 
teacher success. While the study has been lim- 
ited by small numbers in many of the sub-groups, 
nevertheless, differences in personality profiles 
did occur for the different supervisory categories. 

Although relatively small samples are fre- 
quently adequate in statistical studies, in inves- 
tigations of this nature, because of the large 
number of sub-groups into which the total group 
is broken down, the sub- groups are frequently 
too small to permit of statisticaltreatment. Such 
an investigation demands ext remely large num- 
bers if a statistical study is to be made. Such 
studies might be carried onover a period of years 
and withthe cooperation of several large teacher- 
training institutions. 

The natural processes of college life and the 
efforts of testing, counseling, and guidance per- 
sonnel tend to eliminate many of the persons with 
extreme personality deviations from the rolls of 
candidates for teaching positions. The MMPI 
can be of help in identifying these individuals. It 
has potential usefulness in aiding in the predic- 
tion of the success of those who do accept teach- 


ing positions. 


FOOTNOTES 


Rostker, L. E. “Тһе Measurement of Teach- 
ing Ability, '' Journal of Experimental Ed- 
ucation, XIV (1945), p. 50. 

2. Lins, L. J. “Тһе Prediction of Teaching 
Efficiency, " Journalof Experimental Edu- 
cation, XV (1946), p. 59. 

3. Lins, op. cit. 

LaDuke, C. V. “Тһе Measurement of Teach- 
ing Ability, " Journal of Experimental Ed- 
ucation, XIV (1945), p. 100. 

Albert Ellis, Consulting Psychologist, 333 W. 
56th Street, New York 19, New York. 

Buros, Oscar F., (Editor), Fifth Mental 
Measurements Yearbook (Highland Park, 
N. J.: The Gryphon Press, 1959), p. 166. 

Drake, L. E. and Oetting, E. R. An MMPI 


354 


13. 


14, 


15. 


16. 
17. 


JOURNAL OF EXPERIMENTAL EDUCATION 


Codebook for Counselors (Minneapolis: Un- 
iversity of Minnesota Press, 1959), p. 10. 
Hathaway, J. R., and Monachesi, E. D. Ana- 
lyzing and Predicting Juvenile Delinquency 
with the MMPI (Minneapolis: University of 
Minnesota Press, 1953), pp. 13-28. 


. Lins, op. cit. 
. Hathaway, S. В. “А Coding System [ог 


MMPI Profiles,” Journal of Consulting Psy- 
chology, XI (1947), pp. 334-37 


. Hathaway, op. cit. 
. Du Mas, F. M. 


**On the Interpretation of 
Personality Profiles," Journal of Clinical 
Psychology (1947), pp. 57-65. 

McCall, William A., and Krause, Gertrude 
R., *Measurement of Teacher Merit for 
Salary Purposes, ” Journal of Educational 

Без И 


Social, Biological, and Medical Sciences 
(Danville, Ш.: Interstate Printersand Pub- 
lishers, 1957), p. 52. 

Walker, Helen and Lev, Joseph. Statistical 
Inference (New York: Holt, 1953), p. 107. 

Tate and Clelland, op. о, p. Ті. 

Cochran, W. 6, "ће Comparison of Per- 
centages in Matched Samples,” Biometrika, 
XXXVII (1550), pp. 256-66. ma 


18. Lindquist, E. F. 


19. 


20. 
21. 
22. 
23. 
24. 
25. 


26. 


27. 
28. 


29. 


Statistical Analysis in Ed- 
ucational Research (Chicago: Houghton Mif- 


Шп Co., 0), pp. 44-5. | 
Ап explanation of this method of calc ulating 
chi-square may be found in the Appendix. 

Walker and Lev, op.cit., pp. 105-6. 

Drake and Oetting, op. cit., pp. 24-5. 

Ibid., p. 13. к 

Ibid., pp. 22.3. 

Ibid., p. 15. 

Siegel, Sidney, Nonparametric Statistics for 
the Behavioral Sciences (New York: McGraw 
Hill, 1956), pp. 96 ff. 

Finney, D. J. “The Fisher -Yates Test of 
Significance in 2 x 2 Contingency Tables, 
Biometrika, XXXV (1948), pp. 149-54. 

Drake and Oetting, ор. cit. 

Drake, L. E., “Scale 0 (Social Introver- 
Sion)," in Basic Readings on the MMPI in 
Psychology and Medicine, G. S. Welsh 
and W. G. Dahlstrom ; editors (Minne- 
apolis: University of Minnesota Press, 
1956). 

Drake, L. E., and Thiede, W. B. ‘Further 


Validation of Scale 0 (Si), '" in Basic Read- 
ings on the MMPI in Psychology and Medi- 
cine, G. S. Welsh and W. G. Dahlstrom, 
editors (Minneapolis: University of Minne- 
Sota Press, 1956). 


= —X 


JOURNAL OF EXPERIMENTAL EDUCATION 
(Volume 29, Number 4, June 1961) 


A COMPARISON OF TEACHERS’ RESPONSE 
PATTERNS ON THE MMPI WITH RESPONSE 
PATTERNS OF SELECTED 
NON-TEACHER GROUPS 


ELMER CHRISTIAN RIECK* 
Wisconsin State College 
EauClaire, Wisconsin 


SECTIONI 


The Problem and Its Importance 


Statement of the Problem 


THE PURPOSE of this study was to identify and 
hen compare profile patterns of teachers on the 
&roup form ofthe Minnesota Multiphasic Person- 
ality Inventory, hereafter referred to as the 
MMPI, with the profile patterns of selected non- 
teacher groups of students at the University of 
’isconsin. The three main groups studied, di- 
Vided according to sex, were students who were 
8raduated from the University of Wisconsin with 


aching certificates, students with majors in 
Letters and Science who did not prepare for teach- 
ho dropped 


‘ng, and freshmen and sophomores W 

Out prior to starting the junior year. Those who 

Prepared for teaching were further subdivided in- 

9 Academic and special field majors. 

th Specifically, the researcher will 
© following four questions: 


deal with 


patterns are found 
uated from the Un- 
hing certifi- 


1. What, if any, MMPI profile 
for students who were grad 
lversity of Wisconsin with teac 
Cates? Р 
à. Graduates of the Scho ol of Education with 
academic majors. V i - 

b, Graduates withteaching certificates е 
cial fields— Home Economics, aa тий 
Culture, Art Education, and Physic 
cation. 


2. What, i; any, MMPI profile patterns are found 


ny people 


ommittee. and Professors L. Е. 
d have been extremely generous S 
guidance, constructive criticism 

i w 
also extended to my friends and associates 


* wast 
на through the cooperation rn S. Barr, the writer’s 
nd expressed to Professor a Drake and H. J. Klaus 

in giving the 
nd епсочга 
ho have 


ir time an 
gement is dee | 
encouraged and ai 


for students who were graduated from the Un- 
iversity of Wisconsin from the College of Let- 
ters and Science but did not prepare for teach- 


ing? 


3. What, if any, MMPI profile patterns are found 
for students who dropped out of the University 
prior to starting the junior year? 


4. If profile patterns are found, how do they com- 
pare among these groups? 


It is hoped that the results ofthe study may 
prove useful in counseling students in deciding 
between teaching and other non-teaching careers. 

The writer became interested in the MMPI 
when in student personnel work during the period 
of 1948-58. Duringthese years he was privileged 
to see and counsel many students who sought guid- 
ance and who requested assistance in personnel, 
academic, social, and vocational problems. It 
was his primary function to help facilitate the 
growth and development ofthe student of a realis- 
tic understanding of himself and his relationship 
with society. 

In the discharge of such functions the use of 
psychometric data may be very helpful. On the 
other hand, they may lead, at times, to erroneous 
conclusions. The fact that psychometric data are 
often useful in many situations must grow out of 
their basic validity for the purpose used. 

While most of the earlier researches on the 
MMPI were done in a hospital setting, research 
has been conducted in a variety of situations with 
more normal persons. Drake and his associates 
(10) have made a number of studies with university 


his study possible. My sincere gratitude and appreci- 


major professor and Chairman of the Reading 
meier, members of the Reading Committee. 
d effort to this investigation. Their continu- 
ply appreciated. My sincere gratitude is 
ded in this study. 
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students. 


Importance of the Problem 


At the present time nearly every large univer- 
sity and most of the smaller institut ions offer 
their students some type of guidance Service. At 
the University of Wisconsin, for example, the 
Student Counseling Center has offered this ser- 
vice to the students since the Center opened in 
1944. 

One of the important functions of these coun- 
seling centers is that of academic and vocational 
guidance. The work of assisting students in se- 
lecting their academic and vocational goals is dif- 
ficult. Because of the demands on the part of the 
students for this type of help and the desire on 
the part of the counselors to be effective, it was 
necessary that the MMPI be carefully studied so 
that it may be used as effectively as possible. 

The present study was designed to obtain more 
information about the suitability of using the MMPI 
with University of Wisconsin Students in academ- 
ic and vocational guidance, especially in the se- 


SECTION II 


The Procedures Used in the Investigation 


The Design of the Study 


The study here reported was of the compara- 
tive-descriptive type in which groups of prospec- 
tive teachers and non-teaching groups were com- 
pared upon scales and profile patterns of the 
MMPI. Ш ап exploratory Study such as this, it 
seemed best to work with a well-defined popula- 
tion about whom precise and complete information 
could be had. The study concerned students en- 
rolled at the University of Wisconsin duri ng the 
fall semesters of 1949, 1950, and 1951. 


The Minnesota Multiphasic 
Personality Inventory 


The MMPI was chosen as the measuring instru- 
ment to be used in this study. It is normally ad- 
ministered to students entering as freshmen dur- 
ing freshmen orientation week at the University 
во and the profile codes are entered оп 
о ш. s by the staff of the Student Counseling 
Center. Profiles and other data were thus ob- 

ined for the subjects upon the basis of which 
iie parisons were made of the several profile 
© 


wert PI is a psychometric instrument de- 


veloped at the University of Minnesota. It isa 
product of S. R. Hathaway, Professor and Direc- 
tor of the Division of Clinical Psychology, Uni- 
versity of Minnesota, and J. C. McKinley (де - 
ceased) formerly Head of the Department of Neu- 
ropsychiatry, University of Minnesota. The In- 
ventory was designed to provide, in a single test, 
Scores on all the more important clinical phases 
of personality. It seemed that a multiphasic per- 
Sonality inventory would be best Suited for our 
purposes. 

The instrument consists of 550 different state- 
ments covering a wide range of subject matter, 
from the physical conditionofthe individual being 
tested to his morale and attitude (15). In admin- 
istering the test, the subject is asked to respond 
to all Statements, which are in the first person, 
as True, False, or Cannot Say. After he has re- 
sponded to all items in this manner, the responses 
are scored and tabulated to faciliate this part of 
the operation. Drake, at the University of Wis- 
consin Counseling Center, has recorded the sig- 
nificant responses on anIBM machine score sheet. 
This device saves considerable time and labor in 
Scoring. Experimentation has shown that it 15 
adapted to useful classification and understanding 
of college students. 


Subjects and Data-Gathering Procedures 


The students for this Study were students at 
the University of Wisconsin who entered as fresh- 
men in the fall semest ers of 1949, 1950, and 
1951. 


A list of the students who were graduated in 
1953, 1954, and 1955 with teaching certificates 
Was obtained from the Office of the Dean of the 


Subjects, 99 were males and 277 females. The 


group. 
The total population consisted of 1407 students, 
males and 753 females. The profile patterns 
and other data Were obtained from the files of the 
Student Counseling Center. i 
Graduates from the College of Letters and Sci- 
ence and freshman and sophomore drop-outs меге 
Secured from the reco rds on file at the Alum”! 
Records Office, The profiles of all the Letters 


and Science students wh h ken the MMPI in 
1949, 1950, and 1 Гаек 


278 males апа 15 


ОШ group. This represented all subjects for whom 
both drop-out records and ММРГв were available: 


——À M". ——— 7”. 


Inasmuch as this study attempted to identify and 
then compare profile patternsof students who sub- 
Sequently become teachers with profile patterns 
of other selected groups of students, the subjects 
were divided into four groups as follows: 


l. University of Wisconsin graduates with teach- 
ing certificates inthe academic subject fields. 


2. Graduates with teaching certificates in special 
fields— Home Economics, Music, Agriculture, 
Art Education, and Physical Education. 


3. Students who were graduated from the Univer- 
Sity of Wisconsin from the College of Letters 
апа Science but did not prepare for teaching. 


4. Students who dropped out of the University 
prior to starting the junior year. 


Inorder to identify common profile patterns 
among individuals within a group and to compare 
Possible profile patterns among groups, each 
group must show relatively homogenous behaviors 
Оп the MMPI. Therefore, the group must be se- 
lected on the basis of as many common underly- 
ing traits as possible. Inthis study the groups 
Were divided in accordance to sex and education 
and/or vocational goals. 


Coding of the Data 


The coding system of the profile analysis was 
that reported by Hathaway (14). The scales were 
assigned numbers as follows: 


0 Si - Social Introversion 

1 Ha - Hypochondriasis 

2 D - Depression 

3 Hy - Hysteria 

4 Pd - Psychopathic Deviate 
5 Mf - Masculinity- Femininity 
6 Ра - Paranoid 

7 Pt - Psychasthenia 

8 Sc - Schizophrenia 

9 Ma - Hyponrenia 

x None 


All the scales with T scores above 54 were coded 
igh and arranged according to magnitude. Only 
the three highest scales were used in this study. 

he scales with T scores of 45 or less were coded 
OW with a maximum, in this study, of two being 
Coded low except in cases where there were ties 
Іп which case the first three low scales were in- 
cluded, 


Tabulating the Data 


1 The frequency of occurrence of each of the fol- 
Owing patterns of scales were tabulated (8): 
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- The frequency of each scale coded high among 

the three highest scales. 

2. The frequency of each scale coded low among 
the two lowest scales. (In case of a tie, the 
first three low scales were included. ) 

3. The frequency of each pair of scales coded 
among the three highest scales. 

4. The frequency of each scale coded high of the 
three highest with each scale coded low of the 
two lowest. 

5. The frequency of each pair of high scales coded 

among the three highest with each scale coded 

low of the two lowest. 


Comparisons of the profile patterns among the 
main groups of students were made by Yule's 
formula for differentiation of groups (25). This 
formulaassumes randomly drawngroups. Strict- 
ly speaking, these groups were not randomly 
drawn. However, for some larger group of Wis- 
consin graduates, the groups might be regarded 
as random groups. To make such a statement it 
must be assumedthat conditions remain unchanged 
in all essential conditions and that these condi- 
tions persist for some period of time; also that 
the types of individuals appearing in the data have 
anequalopportunity to appear at each successive 
drawing. The data here are for graduates who 
entered as freshmen in three separate years, 
namely, 1949, 1950, and 1351. The statistical 
test employed in the study answers the question: 
What are the probabilities that differences as 
great or greater than those found might have 


arisen by chance? 


SECTION III 


Statistical Analysis and Findings 


Introduction 


The purpose ofthis study, as stated in Section 
I, was to identify and compare profile scales and 
patterns of teachers on the group form of the 
MMPI withthe profile patterns of selected non- 
teacher groups of students at the University of 
Wisconsin. The following four questions were 


asked: 


1. What, if any, MMPI profile patterns are found 
for students who graduated from the University 
of Wisconsin with teaching certificates? 

a. Graduates of the School of Education with 
academic majors. 

b. Graduates withteaching certificates in spe- 
cialfields— Economics, Music, Agriculture 
Art Education, and Physical Education. 


2. What, if any, MMPI profile patterns are found 
for students who were graduated from the col- 
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lege of Letters andScience but did not prepare 
for teaching? 

3. What, if any, profile patterns are found for 
students who dropped out ofthe University prior 
to starting the junior year? 

4. If profile patterns are found, how do they com- 
pare among these groups? 


In order to answer these questions it is neces- 
sary to explain how the data were analyzed and 
what the statistical findings were, 


Yule's Formula for Differentiations of Groups 


In Section II, The Design of the Study, the 
MMPI, the coding of the data, the procedure for 
tabulating the data, were explained. These data 
were analyzed through the use of Yule’s (25) form- 
ula for differentiation of groups. The significant 
difference between the groups was determined by 


the use of the formula for the standard error of 
differences. 


_ Pi 41 рг 92 – а 
е2 = Со n C.R. = в 
where 


еіз is the standard error of difference 


pi = the percent of our group having the given 
code type 


qı = the percent of the group not having the given 
code type 

р» = the percentofthe other group having the given 
code type 

а; = the percent ofthat group not having the given 
code type 

n, and n; = the number of individuals in each 
group (25) 


The size of е2 is an index of the probability 
of the difference in pro po rtions arising through 
chance due tothe factthatthe researcher sampled 
the total number of persons engaged as explained 
in Section П. Accordingto Yule, if the difference 
in proportion does not exceed three times the er- 
ror of the difference, it may be obliterated by an 
error of simple sampling on taking fresh samples 
in the same way from thesame material. But for 

actical purposes the probability of the differ- 
ae being obliterated inthis manner is very little 
less if the error is twice the difference in pro- 
apt comparisons were made for each sex, 
male and female, as follows: 


i i tificates in the ac- 

raduates with teaching cer 
Е subject fields were compared with the 
graduates with teaching certificates in special 


fields. 


2. Graduates withteaching certificates in tne ac- 
ademic subject fields were compared with stu- 
dents who were graduated from the College of 
Letters and Science but did not pre pare for 
teaching. 


3. Graduates withteaching certificates in the ac- 
ademic subject fields were compared with stu- 
dents who dropped out of the University prior 
to starting the junior year. 


4. Graduates with teaching certificates in special 
fields were compared with students who were 
graduated from the College of Letters and Sci- 
ence but did not prepare for teaching. 


9. Graduates withteaching certificates in special 
fields were compared with the students who 
dropped out of the University prior to starting 
the junior year. 


6. Students who were graduated from the College 
of Letters and Science but did not prepare for 
teaching were compared with the students who 
dropped out of the University prior to starting 
the junior year. 


In this study a difference in percent was con- 
Sidered significant by the researcher if it was two 
or more times as great аз its standard error, i.e., 
it is significant beyond the 5 percent level. 


Statistical Findings 
=== ndings 


The statistical findings are summarized in the 
tables that follow, They include results for those 
scales and patterns for which the difference be- 
tween the groups compared is two or more times 
as great as the standard error (9). Code types 
refer to the coding of the scales, either high ог 
low, and combinations of scales, paired high and 
high with low. 

In this invest igation, combination of scales 
Paired high with low scales were not tested for 
Significance. The frequencies of occurrence for 
this code type appear in the Appendix (which will 
be found in original thesis on file in Library of 
University of Wisconsin). It was felt that there 
was an insufficient number of subjects to allow 
tests for significant differences between these 
very low frequencies, For the interested re- 
Searcher some statistical comparisons could be 
made and other information gained from inspec- 
tion, if so desired. Drake (9) has reported the 
requency of occurrence of à number of patterns 
found in male clients, 

In reporting the findings, the tables show je 
the frequency of occurrence of th 
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TABLEI 


COMPARISON OF GRADUATES WITH TEA! 
CHING CERTIFICATE 
SUBJECT FIELDS WITH THE GRADUATES WITH TEACHING даваа T 
IN SPECIAL FIELDS— MALES ы 


Percent of ue РА 
Соде Туреѕ Academic Group Fields Group kc 
X High 14..3* 00.0 2.42 
T Тоу 08. 6* 26. 6* 2.47 
13 Paired High 00.0 07.8 2. 33 
46 Paired High 00.0 09. 4* 2.58 
2-9 High with Low 00.0 06. 3 2.07 
3-2 High with Low 00.0 07. 8* 2. 33 
4-8 High with Low 00. 0 10.9* 2.19 
6-7 High with Low 00. 0 06. 3 2.07 
35 64 


Number in each group 
present samples of 5 or more cases in one or the other of the com- 


*These items re р 
pared group N. B. after the number in each case. 


TABLE II 


UATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
m - QT EDS WITH THE GRADUATES WITH TEACHING CERTIFICATES 
N SPECIAL FIELDS— FEMALES 


I 
Percent of 
Percent of Special — 
Code Types Academic Group Fields Group кз 
id mr 2.14 
0 Low 
42, 1* 30. 1* m 
5 Low 3 
90-0 2.26 
‚0* 
12 Paired High 03 нері р 
3. OF | 
0-3 High with Low 0 ^ un 
Ed З 
4-6 High with Low 03 sd A 
E 1 : 
5-1 High with Low 02 ма өз 
6; 5* Я у 
9-5 High with Low 1 И 
164 
Number in each group | и 
or more cases in one or - 


z 75165 of 
"Liese та P pon P amber in each сазе. 


pared group N. B. after 
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TABLE III 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE 
OF LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING—MALES 


Percent of 


Percent of Letters and Critical 
Code Types Academic Group Science Group Ratio 

X High 14. 3* 0.7 2.28 
8 High 42. 9* 25.2* 2.02 
0 Low 31. 4* 58.9* 3.28 
05 Paired High 00.0 03. 6* 3. 21 
13 Paired High 00.0 07. 2* 4.65 
14 Paired High 00.0 03. 6* 3. 21 } 
36 Paired High 02, 7 11.2* 2.43 
46 Paired High 00.0 03. 6* 3.21 
56 Paired High 02.9 11,5% 2.51 
67 Paired High 00.0 02.2* 2.49 
0-X High with Low 00.0 01. 8* 2.25 
1-0 High with Low 00.0 06. 5* 4. 39 
1-" High with Low 00.0 02.5* 2.66 
1-9 High with Low 00.0 02. 5* 2.66 
2-9 High with Low 00.0 03. 6* 3.21 
3-1 High with Low 00. 0 05. 8 4.14 
3-2 High with Low 00.0 05. 0* 3. 82 
3-4 High with Low 00.0 02.5* 2.66 
4-0 High with Low 05.7 16. 9* 2.4" 
4-8 High with Low 00.0 01, 8* 2. 29 
4-9 High with Low 00.0 07. 7* 4. 81 
6-0 High with Low 02.9 10.1* 2.14 
6-7 High with Low 00.0 05. 4* 4. 00 
7-0 High with Low 00.0 04. 0* 3. 39 
7-1 High with Low 00.0 02.5* 2. 66 
7-9 High with Low 00. 0 04. 0% 3. 39 
8-1 High with Low 00.0 01. 8* 2.25 
8-6 High with Low 00.0 03. 6* 3.21 
9-3 High with Low 00.0 02.2* 2.49 
9-4 High with Low 00.0 03. 6* 3.21 
Number in each group 35 278 
*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 


= | 
о —— 
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TABLE IV 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE 
OF LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING— FEMALES 


Percent of 
Percent of Letters and Critical 
Code Types Academic Group Science Group Ratio 
3 High 28. 0* 39.1* 2.09 
5 Пом 42. 1 26.5* 2.96 
78 Paired High 20. 1* 11.3* 2.17 
1-6 High with Low 02.4 00.0 2.00 
2-9 High with Low 04. 9* 00.0 2.90 
* 
3-X High with Low 02.4 06. 6 2.03 
07. 9* 2.20 
3-1 High with Low 02.4 
06. 0% 2,95 
4-5 High with Low 13. 4* 
* 0.7 2.32 
4-9 High with Low 04. 9 
* 12. 6* 2.42 
7-X High with Low 04. 9 
* 02.0 2.08 
7-0 High with Low 06. 7 
12. 6* 2.24 
7-5 High with Low 22. 0* 
15. 9* 07. 9* 2.22 
8-5 High with Low . 
04. 9* 0.7 2. 31 
8-9 High with Low 
164 151 
Number in each group 
amples of 5 or more cases in one or the other of the com- 


sent S 


* i repre 
These items гер: fter i 


i h case. 
e number in eac 
pared group М. В. 4 
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TABLE V 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE ACADEMIC 
SUBJECT FIELDS WITH STUDENTS WHO DROPPED OUT OF THE UNIVERSITY 
PRIOR TO STARTING THE JUNIOR YEAR— MALES 


Percent of Percent of Critical 
Code Types Advanced Group Drop-Outs Ratio 
X High 14. 3* 02.2* 2.02 
" Low 08.6 23.5* 2.77 
02 Paired High 00.0 02. 9* 2. 87 
05 Paired High 00.0 01. 8» 2.25 
09 Paired High 00.0 01. 8% 2.25 
13 Paired High 00.0 04. 7* 3. 69 
14 Paired High 00. 0 01. 8* 2.25 
34 Paired High 02.9 09. 7* 2.03 
37 Paired High 00. 0 02.2* 2.49 
38 Paired High 00.0 02.5* 2. 66 
46 Paired High 00.0 05.1% 3. 83 
49 Paired High 05. 7 15. 2* 2.24 
67 Paired High 00.0 04. 0* 3. 39 
9X Paired High 00.0 01. 8* 2.25 
0-X High with Low 00.0 01.8* 2.25 
0-1 High with Low 00.0 02.2* 2. 49 
0-2 High with Low 00.0 02.2* 2.49 
0-5 High with Low 00. 0 02. 2* 2.49 
0-6 High with Low 00. 0 03. 6* 3.21 
1-2 High with Low 00. 0 02.5% 2. 66 
1-9 High with Low 00.0 02.2* 2.49 
2-9 High with Low 00.0 04. 3* 3.52 
3-2 High with Low 00.0 04. 3* 3.52 
3-5 High with Low 00.0 03.2* 3. 02 
4-5 High with Low 00. 0 02. 2* 2. 49 
4-8 High with Low 00. 0 05. 1 3.83 
4-9 High with Low 00.0 02. 9* 2:87 
5-3 High with Low 00.0 03.2* 3. 02 
6-7 High with Low 00.0 05.1* 3.83 
6-9 High with Low 00. 0 03. 2* 3.02 
7-1 High with Low 00.0 02. 9* 2.87 
7-5 High with Low 00.0 02. 5* 2.66 
7-9 High with Low 00.0 03. 6* 3.21 
8-X High with Low 28. 6* 12.3* 2.06 
8-5 High with Low 00. 0 02.2* 2. 49 
8-6 High with Low 00.0 03. 6* 3.21 
9-3 High with Low 00.0 03. 6* 3.21 
9-4 High with Low 00.0 01. 8* 2.25 
9-7 High with Low 02.9 11.9* 2. 62 
Number in each group 35 211 


*These items represent samples of 5 or more cases in one or the 


other of the com- 
pared group N. B. after the number in each case. 


RIECK 


TABLE VI 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN THE 
A 
SUBJECT FIELDS WITH STUDENTS WHO DROPPED OUT OF THE UNIVERSITY Н 
PRIOR TO STARTING THE JUNIOR YEAR— FEMALES 


Percent of Percent of Critical 

Code Types Academic Group Drop-Outs Ratio 
5 Low 42.1* 26. 7* aw 
7 High 42. 1% 32 0% 2 04 
9 High 39. 0* 50. 7* 2. 30 
29 Paired High 00.0 02.2* 2.94 
49 Paired High 07. 3* 14, 2* 2.23 
59 Paired High 04. 9* 11.1* 2.30 
78 Paired High 20. 1* 12 4* 2.00 
4-1 High with Low 0.6 05. 8* 3.11 
6-0 High with Low 06. 1* 12, 9* 2.34 
7-5 High with Low 22. 0* 13. 8* 2.09 
7-9 High with Low 06. 7* 01.3 2 57 
8-5 High with Low 15. 9* 08. 9* 2.04 
9-1 High with Low 04. 3* 11,6% 2. 14 
9-7 High with Low 05. 5* 116» 9.19 
9-8 High with Low 00. 0 03. 6* 2.90 

164 225 


Number in each group 
ent samples of 5 or more cases in one or the other of the com- 


fter the number in each case. 


*These items repres 
pared group N. B.a 
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TABLE VII 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIELDS 
WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF LETTERS 
AND SCIENCE BUT DID NOT PREPARE FOR TEACHING— MALES 


Percent of Percent of 
Special Letters and Critical 
Code Types Fields Group Science Group Ratio 
0 Low 29. тж 58. 9* 4.52 
8 Тоу 26. 6* 12.6* 2.38 
08 Paired High 00.0 03. 2* 3. 02 | 
14 Paired High 00.0 03. 6* 3.21 
19 Рашеа High 01.6 07.2* 2.55 
29 Paired High 00.0 01. 8* 2.25 | 
39 Paired High 04. 7 13. 7* 2.69 " 
45 Paired High 04.7 12. 9* 2,47 
0-Х High with Low 00. 0 01. 8* 2.25 | 
1-0 High with Low 01.6 06.5* 9.28 
3-X High with Low 01.6 05.8* 2.00 | 
3-4 High with Low 00.0 02.5* 2.66 
3-6 High with Low 00.0 02.2* 2.49 
4-0 High with Low 03.1 16. 9* 4. 42 
4-6 High with Low 00.0 03. 6* 3.21 
4-8 High with Low 10. 9* 01. 8* 2.29 
7-1 High with Low 00.0 02. 5* 2. 66 
8-3 High with Low 00.0 02. 5 2.66 
8-9 High with Low 00.0 02.5* 2.66 
9-X High with Low 04. 7 11.2* 2.00 í 
9-0 High with Low 09. 4* 22. 7* 3.00 
9-3 High with Low 00. 0 02.2* 2. 49 
Number in each group 64 278 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 


RIECK 


TABLE VIII 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES I 
NS 
WITH STUDENTS WHO WERE GRADUATED FROM THE COLLEGE "РВ d 
AND SCIENCE BUT DID NOT PREPARE FOR TEACHING— FEMALES 


Percent of Percent of 
Special Letters and Critical 

Code Types Fields Group Science Group сов 
3 High 26.5* 39. 1* e 
2 mE 32. 7* 49. т» 2.83 
3 Тоу 13. 3* 04. 6* 2. 40 
04 Paired High 03.5 00.0 "а 
39 Paired High 05. 3* 13.9* 2.44 
5X Paired High 07. 1* 01.3 2.24 
67 Paired High 11, 5% 04. 6% 2.00 
79 Paired High 10. 6* 19. 2* 2.20 
89 Paired High 00. 7 14. 6* 3.50 
4-6 High with Low 00. 0 02. 6 2. 00 
5-1 High with Low 09. 7* 03. 3* 2.06 
5-3 High with Low 04. 4* 00.0 2.28 
6-0 High with Low 03.5 11.3* 2.52 
7-3 High with Low 08. 0* 01.3 2.47 
7-5 High with Low 23.9* 12. 6% 3.33 
9-0 High with Low 08. 8* 16. 6* 2.25 
9-7 High with Low 03.5 08. 6* 2,17 
Number in group 113 151 

samples of 5 ог more cases in one or the other of the com- 


Б і esent 
These items repr i сөлін EE 


pared group М. B. after the number 


366 JOURNAL OF EXPERIMENTAL EDUCATION 


TABLE IX 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIE LDS 
WITH THE STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIOR 
TO STARTING THE JUNIOR YEAR— MALES 


Percent of 
Special Percent of Critical 

Code Types Fields Group Drop-Outs Ratio 
Х High 00.0 02. 2* 2.49 
3 Low 01.6 08. 7* 3.07 
8 Low 26. 6* 13. 1 2.19 
02 Paired High 00.0 02. 9* 2.87 
08 Paired High 00.0 03. 6* 3.91 
14 Paired High 00.0 01. 8% 2,25 
29 Paired High 00.0 03.0* 3.36 
38 Paired High 00. 0 02.5% 2. 66 
39 Paired High 04. 7 11. 9* 2.19 
5X Paired High 00.0 01. 8% 2.25 
58 Paired High 15. 6* 04. 3* 2.40 
0-X High with Low 00.0 01. 8* 2.25 
0-1 High with Low 00.0 02.2* 2.49 
0-5 High with Low 00.0 02.2* 2.49 
1-5 High with Low 00.0 01. 8* 2.25 
3-6 High with Low 00. 0 03. 6* 98,21 
4-0 High with Low 03.1 11.6* 2.93 
4-6 High with Low 00.0 02. 9* 2.87 
5-3 High with Low 00.0 03.2* 3.02 
7-1 High with Low 00.0 02. 9* 2.87 
8-3 High with Low 00. 0 04. 0* 3. 36 
8-5 High with Low 00. 0 02.2* 2.49 
9-X High with Low 04. 7 11.6* 2.11 
9-3 High with Low 00. 0 03. 6* 3.21 
9-6 High with Low 04. 7 11. 6 2.11 

Number in group 64 277 


*These items represent samples of 5 or more cas 
pared group N. B. after the number in each case. 


ев in опе or the other of the com- 


у ж. ими 


RIECK 


TABLE X 


COMPARISON OF GRADUATES WITH TEACHING CERTIFICATES IN SPECIAL FIELDS 
WITH THE STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIOR 
TO STARTING THE JUNIOR YEAR— FEMALES 


Percent of 


Special Percent of Critical 

Code Types Field Groups Drop-Outs ia 
9 High 32. 7* 50. 7* т: 
0 Low 16. 8* 30.2 жа 
9 Low 19,5% 09. 3* қү 
12 Paired High 00.0 01. 8 2.02 
15 Paired High 00. 0 02.2* 2.24 
16 Paired High 00.0 02. 7* 2.50 
23 Paired High 00. 9 04. 9% 2.35 
3X Paired High 05. 3* 00.9 3.00 
39 Paired High 05. 3* TL. 6% 2.10 
6X Paired High 00.0 02. 7* 2. 03 
64 Paired High 02. 7 07. 6* 2.10 
69 Paired High 00. 2 12. 9* 3.98 
0-9 High with Low 10. 0* 03.1* 2. 40 
1-7 High with Low 00.0 01.8 2.02 
4-1 High with Low 01.8 05.8* 2. 00 
4-6 High with Low 00. 0 03.1* 2. 10 
5-9 High with Low 0T. 1* 00.9 2.50 
6-0 High with Low 03.5 12.9* 3.33 
6-1 High with Low 01.8 06. 7* 2. 36 
7-5 High with Low 23. 9* 13.8* 2.18 
9-0 High with Low 08. 8* 20.0* 2.90 
9-7 High with Low 03.5 11. 6* 2.96 
Number in group 113 225 

mples of 5 or more cases in one or the other of the com- 


*These items represent sa 


pared group N. B. after the number in each case. 
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TABLE XI 


COMPARISON OF STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF 
LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING WITH THE 
STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIO TO 
STARTING THE JUNIOR YEAR—MALES 


Percent of 
Letters and Percent of Critical 

Code Types Science Group Drop-Outs Ratio 
1 High 18. 9* 11. 6* 2.13 
5 High 54. 7% 35,1% 4.57 
0 Low 58. 9% 23. 8% 8.97 
3 Low 03. 6* 08. 7% 2.51 
5 Low 02.2* 07.2* 2.80 
15 Paired High 05. 8* 01. 8* 2.50 
19 Paired High 07.2* 03.2* 2.13 
57 Paired High 14, 0* 05. 4* 3.47 
58 Paired High 09. 4* 04. 3* 2.39 
0-5 High with Low 00.0 02. 2* 2.49 
1-0 High with Low 06. 5* 01.4 3.12 
1-5 High with Low 00. 0 01. 8 2.25 
3-1 High with Low 05. 8* 01.4 2. 80 
3-4 High with Low 02. 5* 00.4 2.08 
3-5 High with Low 00.4 03. 2* 2. 39 
4-8 High with Low 01. 8* 05.1* 2.13 
4-9 High with Low 07. 7* 02. 9* 2.54 
5-3 High with Low 00.4 03.2* 2.50 
5-4 High with Low 04. 0* 01.1 2.18 
7-0 High with Low 04. 0* 00. 7 2.58 
7-2 High with Low 00.4 02. 9* 2.31 
7-5 High with Low 00. 0 02. 5* 2.66 
8-2 High with Low 02. 2* 06. 1% 2.31 
9-0 High with Low 22. 7* 15.5* 2.11 
Number in group 278 277 


*These items represent samples of 5 or more cases in one or the other of the com- 
pared group N. B. after the number in each case. 


RIECK ~ 


TABLE XII 


COMPARIOSN OF STUDENTS WHO WERE GRADUATED FROM THE COLLEGE OF 
LETTERS AND SCIENCE BUT DID NOT PREPARE FOR TEACHING WITH THE 
STUDENTS WHO DROPPED OUT OF THE UNIVERSITY PRIOR TO 
STARTING THE JUNIOR YEAR— FEMALES 


Percent of 
Letters and Percent of Critical 
Code Types Science Group Drop-Outs Ratio 
3 High 39. 1* 27.1* s 
3 Low 04. 6* 10. 7* 2.28 
04 Paired High 00. 0 02. 7* 2.50 
15 Paired High 00. 0 02. 2* 2.24 
26 Paired High 00.7 03. 6* 2.07 
2-9 High with Low 00. 0 03. 1* 2.67 
3-2 High with Low 10. 6* 03. 6* 2.50 
5-3 High with Low 00. 0 02.2* 2.24 
5-9 High with Low 04. 6* 00. 9 2.03 
6-3 High with Low 00. 7 04. 0* 2.24 
1-X High with Low 12. 6* 05. 8* 2.18 
1-3 High with Low 01.3 | 06. 2% 2. 63 
1-5 High with Low 02. 6 13. 8* 3.15 
151 225 


Number in group 


¥These it epresent samples of 5 or more cases in one or the other of the com- 
items r | 
| group М. В. after the number in each case. 
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i differences. 
MÀ relative to male graduates with teach- 
ing certificates in the academic subject fields as 
compared withthe graduates with teaching certif- 
icates in specific fields are given in Table І. Ta- 
ble П makes the same comparisons for females. 
Tables III and IV showthe graduates with teaching 
certificates in the academic subjects as compared 
with the students who were graduated from the 
College of Letters and Science but did not prepare 
for teaching. Tables V and VI show the data for 
graduates with teaching certificates in the aca- 
demic subject fields as compared withthe students 
who dropped out of the University prior to start- 
ing the junior year. 

Comparisons of graduates with teaching cer- 
tificates in special fields with students who were 
graduated fromthe College of Letters and Science 
but did not prepare for teaching are shownin Ta- 
bles УП and VIII. Thesame comparisons were 
made of the graduates in Special fields with stu- 
dents who dropped out of the University prior to 
starting the junior year in Tables IX and X. 

Tables XI and XII show the data in the same 
way for the students who were graduated from 
the College of Letters and Science but did not 
prepare for teaching as co m pared with the stu- 
dents who dropped out of the University prior to 
Starting the junior year. 

Perhaps the most important and highly signif- 
icant finding is the fact that Statistically signifi- 
cant differences did Occur, i.e., personality dif- 
ferences as represented by significant differences 
in pattern of scales of the MMPI did occur in all 
groups. 

At this stage of the research it is not possible 
to actually identify the meanings of these person- 
ality differences. Further research may identify 
the meaning of these code types in personality 
terms. This may point to a better idea of person- 
ality variables in the future. 

It appears from the data that there were fewer 
differences among the graduates with teaching 
certificates in the academic fields as com pared 
with the graduates with teaching certificates in 
the special fields than between any other groups. 
The two groups of graduates with teaching certif- 

icates seem to be relatively hom ogeneous, The 
fact that a grade point average of 2.5 is required 
for admittance to the School of Education may pos- 
ibly account for this finding together with the 
si S шу that ће personality characteristicsthat 
aide ]ead to selection of teaching as a career. 
he Pa largest number of significant different code 
type frequencies occurredin the group of students 
j.d ed out of the University prior to starting 
mM ear. In considering this finding the 
the oc keep in mind that while a sizeable 
paader facademic females (N = 164) was in- 
iere the number of academic males was only 
wt 9 (Ma) coded high and in combination 


with low coded scales was characteristic of the 
drop-out group. Many of the significant differ- 
ences occur in patterns involving scale 7 (Pt), es- 
pecially when scale 7 is coded high with 5 (Mf) 
coded low. The male profiles with no scales (X) 
coded high appears to distinguish the two teach- 
ing certificate groups from the drop-outs. More 
comparisons may be possible through further re- 
search. 

Ап examination of the data also shows that 
more differences in frequencies of code types in 
male groups occurred than in female groups. 
Possibly there are several reasons Гог this. Many 
counselors have found that college females are 
not as concerned about their academic careers 
as are male students. Also, the number of stu- 
dents inthe female group was larger than the male 


group in the groups of graduates with teaching 
certificates. 


SECTION IV 


Summary and Conclusions 


Statement of the Problem 


The purpose of this study was to identify and 
compare profile patterns of teachers with the pro- 
file patterns of selected non-teacher groups of 
Students at the University of Wisconsin on the 
&roupformof the MMPI. The three main groups 
Studied, divided according to sex, were students 
who were graduated Írom the University of Wis- 
consin with teaching certificates, students with 
majors in Letters and Science who did not pre- 
pare for teaching, and students who dropped out 
of the University priorto Startingthe junior year. 
Those who prepared for teaching were further 
Subdivided into academic and spec ial field ma- 
jors. 


Conclusions were drawn with reference to four 
questions: 


1. What, if any, MMPI profile patterns are found 
for students who were graduated from the Un- 
‘versity of Wisconsin with teaching certif- 
icates? 
a. Graduates of the School of Education with 
academic majors. 

b. Graduates with teaching certificates in spe~ 
cial fields Home Economics, Music, A8- 
Ticulture, Art Education, and Physical Ed- 


ucation, 
2. What, if any, profile patterns are found for 
Students who were graduated from the College 
of Letters and Science but did not prepare 10: 
teaching? 
3. What, if апу, profile patterns are found ЮГ 


students who dropped out of the University prior 
to starting the junior year? 


4. If profile patterns аге found, how do they com- 
pare among the groups? 


While most of the earlier researches on the 
MMPI were done in a hospital setting, research 
has been conducted in a variety of situations with 
normal persons, especially with university stu- 
dents. 


The Design of the Study 


The study here reported was of the compara- 
tive-descriptive type in which groups of prospec- 
tive teachers and non-teaching groups were com- 
pared upon scales and profile patterns ofthe MMPI 
In an exploratory study such as this it seemed 
best to work with a well defined population about 
Whom precise and rather complete information 
could be had. The study concerned students en- 
rolled at the University of Wisconsin dur ing the 
fall semesters of 1949, 1950, and 1951. | 

The present study was designedto obtain more 
information about the suitability of using the 
MMPI with University of Wisconsin students in 
academic and vocational guidance, especially in 
the selection of future teachers. The MMPI is a 
widely used instrument and has been found useful 
in clinical studies. It is important that its value 
for this particular purpose should be ascertained. 

The data were analyzed through the use of 
Yule’s formula for differentiation of groups. 


Pi qı pa Чг 
agas ut * gr 


fferences between the groups 


the use of this formula. | 
s were found in six 


The significance of di 
were determined by 

Difference in profile pattern 
comparisons made for each sex. 


Findings 
The detailed findings briefly summarized were: 


l. The most important and highly significant ка 
ing is the fact that statistically significant dif- 


ferences did occur among all groups. 


ata that there were few- 
the graduates with teach- 
demic fields as com- 
with teaching certif- 
145 than between any 


2. It appears from the d 
er differences among 
ing certificates inthe aca 
pared with the graduates 
icates in the special fie 
Other groups. 


nificant code type 


3. s 
The largest number of sig p ar addu 


frequencies occurred in the grou 
who dropped out of the University. 
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4. More differences in frequencies of code types 
in male groups occur than in female groups. 


Conclusions 


This study seems to indicate that significant 
differences in profile patterns on a personality 
test can be found between groups of college stu- 
dents with different acade mic histories. While 
the study has been limited by the small numbers 
of persons in some sub-groups, nevertheless, per- 
sonality differences as represented by significant 
differences in patterns of scales of the MMPI did 
occur. 

Research is being continued to determine what 
the profile patterns may mean. In this respect, 
counseling experience and further research may 
help. 

There are many interesting and difficult prob- 
lems inresearchdesignfor this area. Group re- 
search techniques may be employed in building a 
usable formulaor to make useful generalizations. 
Our ultimate concern, however, is with indi- 
viduals. 

Further research is needed in this area to de- 
termine what the profile patterns may mean and 
to find a measure that predicts early and ade- 
quately the personality variables involved in later 


success, 
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А COMPARISON 


OF THE READABILITY OF 


VOCATIONAL AGRICULTURE REFERENCE 


BOOKS WITH THE READING ABILITY 
OF THE STUDENTS USING THEM* 


RALPH R. BENTLEY and R. EDWARD GALLOWAY** 
Purdue University 


Introduction 


TEACHERS OF vocational agriculture often 
complain that their students do not understand what 
they read. In vocational agriculture, as in other 
high-school subjects, reading is one of the most 
effective and efficient (0015 ої learning. However, 
the usefulness of this tool is lost if the material 
to be read does not reasonably match the capabil- 
ity of the reader. If the material is too difficult, 
the student will not comprehend; if it is too sim- 
ple, the student may be insulted and/or bored. In 
either case, learning suffers. | 

Few studies have been reported which attempt- 
ed to match the readability of text or reference 
materials with the reading ability of high-school 
Students. Althoughthe readability of a large num- 
ber of agricultural reference materials has been 
reported, no extensive study was found which 
Compared their readability with the tested read- 
ing ability of the students actually using them. 


P 
Purpose 


eofthis study to compare the 
cultural reference 
of the vocational 
In order to make 


It was the purpos t 
readability of widely used agri 
books with the reading ability 
agriculture students using them. 

his comparison, it was necessary to m gen 

both the readability of vocational agriculture и 
егепсе books and the reading ability of students 
9f vocational agriculture who were using them. 


Procedure 
it лыс АУ. 


5 i ing Schools. One rela- 
э Iber ог Соор nrollment of over 


tively large hi ithan e 
ge high school wi т 
00 students and one relatively small high sehiool 


* Adapted from a Ph. D. diss 


**The authors wish to express their gratitude 
Study. 


ertation completed at Pur 
to the Purdue Research Foundation for its support of this 


with an enrollment of under 100 students were 
chosen in each of the twelve vocational agricul- 
turedistricts in Indiana. Large and small schools 
were selected in each district on the basis of 
three criteria: 1) the school had a department of 
vocational agriculture approved by the Indiana 
State Department of Public Instruction, 2) the 
teacher of vocational agriculture had taught at 
least one year inthe school, and 3) both the teach- 
er of vocational agriculture and his administra- 
tor expressed their willingness to cooperate in 
the study. The basic data for this study were ob- 
tained by testing the reading ability of the voca- 
tional agriculture students in these schools, and 
by measuring the readability of the agricultural 
reference books in their libraries. 

Measurement of Readability. Responses ofthe 
cooperating teachers of vocational agriculture to 
a survey indicated that almost 100 reference books 
wereavailable intheir libraries in quantities 
large enough for class use. Ten of the books 
found most frequently in the cooperating schools 
were chosenfor readability measurement, These 
books were A) Your Farming Program, B) Shop- 
work on the Farm, C) Profitable Farm Manage- 
ment, D) Beef Production, E) Livestock and Poul- 
try Production, F) Approved Practices in Beef 
Production, G) Veterinary Guide for Farmers, 
Н) Crop Production, I) Productive Soils, and J) 
Feeds and Feeding (abr. ). 

— "The Dale-Chall Readability Formula was used 
to measurethe readability or reading difficulty of 
these ten books. This meaurement yielded a 
raw score for each of twenty or more sample 
portions of reading material from each book. The 
readability of each book was expressedas a mean 
and a standard deviation of the sample scores. 
Analysis of variance was used to test differences 


due University. 
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5. 

MEC с Reading Ability. Two tests 
were — to measurethe reading ability of voca- 
tional agriculture students. The Cooperative Eng- 
lish Tests, ‘Test СЕ, **Reading Comprehension " 
used to measure general reading ability, and 

ane сенді Tests of Educational Development, Test 
6, “Ability to Interpret Reading Materials in the 

Natural Sciences’’, was chosenas the most аррго- 

priate test of ability to read tec hnical materials 

in agriculture. The Verbal Battery and the Non- 


rd deviations Were con- 
verted to grade level units, 


St the homo- 
geneity of within-book Variances anq а 


analysis of variance Was used to te. 
cance of differences among the mean Dale-Chall 
readability scores for the ten books. These tests 
indicated that significant differences 

among the variances а 
books. Therefore, each book was 


ability. | 

Both the meanandthe standard deviation read. 
ability for each book was converted from raw Dale. 
Chall score units to grade-leve] units. This made 
a direct compar ison of readability and reading 
ability scores possible, | 

Reading Ability of Vocational 
dents. The raw scores for both 
Reading Test and the Iowa Readin 
basic reading ability data. The 


Agriculture Stu- 
the Cooperative 
Е Test furnisheq 
data for each of 


these tests were analyzed by two-way пон 
variance and presented Separately for each o 
four high-school rades. —" 
It == ndi E that the reading .. 
ninth-grade Students did not differ significan ~ 
with respect to the size and location of the e 
attended. The results of the analysis of е 
for both of the reading tests and the significanc 
of the obtained Е values are shown in Table I. ig 
The reading ability of ninth-grade пе а 2 
measured by the Cooperative and Iowa Веаан g 
Tests (Table 1) did not differ significantly и 
ће cooperating schools when they were er 
by district and size. Thus it was concluded е 
Ше differences among districts and between 81288 
could have occurred by chance and that these Rie 
dents belong to the same population with respec 
to reading ability as measured by these two tests. 
Population means and standard deviations for ~ 
Cooperative and thelowa Reading Tests are show! 
in Table II. | Я 
d that the reading ability О 
did not differ significantly 


The reading 
measured by th 


differ Significant]y among the cooperating schools 
When they wer 


grouped by district and size inis 
ble Ш). Thus it was concluded that the pude scm 
among districts апа between sizes could ee 
occurred by с ance and that these tenth-grade 
Students of Vocational agricult ur e belong to г 
same population with respect to their reading које 
d by the Cooperative test. Tal = 
ћај ninth-grade students аре гуч 
У different from district to district О 


indicate that 5 
Occur in some districts for reading ability a5 
measured by the lowa test. There fare, А icts 
COnclugeq that students in the various distric 5 
р elong to different Populations and that sare 
нога] Schools belong to different S ai 
meas With ге SPect to their reading eure ап 
and Abbas by the Iowa test. The population ative 
Readi estandar deviation for the Coopera ins 
and ed Test аге Shown in Table ту. The peer 
E "Mas Sviations for the Iowa Reading T ge 
and Sven in Та for students in each lar 
pal School py districts, ility 91 
eleventy: hypothesized that the reading abn е 
did not difte io, dents of vocational agricul ize 
dnd үт Significant]y with respect to the 5 
results ofth 9% Schools they attended. ead- 
ing tests е analysis of variance for boria d 
value. 3 апа the Significance of the obtaine 
S are Shown in Тађје VI. 
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TABLE I 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY NINTH-GRADE 


STUDENTS OF VOCATIONAL AGRICULTURE 


Source of Weighted Sums Mean Siznifi 
Variance of Squares d. f. Square vean 

Cooperative Reading Test 
District 1640. 4132 10 164. 0413 N.S 
Size 21. 3928 1 21. 3928 N.S 
Interaction 1168. 760 10 116. 8760 N.S 
Within 20782. 239 194 107. 1249 

Iowa Reading Test 

District 389. 4164 10 38. 9416 N.S 
Size 58. 1405 1 58. 1405 N.S 
Interaction 258. 219 10 25. 822 N.S 
Within 4425. 575 191 23. 1705 


*N.S. indicates that 


the observed F was not significant at the . 05 level. 


TABLE II 


MEANS AND STANDARD DEVIATIONS FOR THE COOPERATIVE 
AND IOWA READING TESTS FOR NINTH-GRADE STUDENTS 
IN TWENTY-TWO SCHOOLS 


Mean Grade Level Grade Levels 


Tests of Ability of S. D. 
Cooperative Reading Ч, 5 2.5 
8.7 2.0 


Iowa Reading 
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TABLE III 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY TENTH-GRADE STU- 
DENTS OF VOCATIONAL AGRIC ULTURE 


Source of Weighted Sums Mean Significance 
Variance of Squares а Square of F Value* 

Cooperative Reading Test 
District 2561.5332 10 256. 1533 N.S 
Size 191.1195 1 191.1195 N.S 
Interaction 22'14. 980 10 227. 498 N.S 
Within 24416. 388 176 139. 0704 

Iowa Reading Test 

District 482. 5512 10 48. 2551 Р<. 05 
Size . 010043 1 ‚010043 N. S. 
Interaction 641. 842 10 64. 1842 Ре. OL 
Within 4134. 81 174 23. 7633 


*N.S. indicates that the observed Е was not significant at the . 05 level, 


TABLE IV 


MEAN AND STANDARD DEVIATION FOR THE COOPERATIVE READ- 
ING TEST FOR TENTH-GRADE STUDENTS IN 
TWENTY-TWO SCHOOLS 


Mean Grade Levels of 
Test Grade Level Standard Deviation 
Cooperative Reading 8.3 3.3 
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TABLE V 


MEANS AND STANDARD DEVIATIONS FOR THE IOWA READING TEST FOR 
TENTH-GRADE STUDENTS BY DISTRICT AND SCHOOL SIZE 


Large Small 
Mean Standard Mean Standard 
District Grade Level Deviation Grade Level Deviation 
Iowa Reading 

I 10.0 2.8 Т; 6 .9 
П 9.4 1.2 11.1 4.2 
Ш 9.8 2.3 11.9 4.6 
ІУ 1, 1 4.9 10.4 2.8 
у 8.6 1.0 10.8 8.2 
vi 11.1 3.8 12.4 5.8 
vu 11.1 3.0 8.0 0.3 
уш 9.8 2.3 9.0 2.3 
IX 8.6 1.8 9.7 1.8 
х 9.3 3.1 12.2 9,7 
9:6 2.9 8.5 2.1 


хп 
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The reading ability of eleventh-grade students 
as measured by the Cooperative and Iowa tests 
did not differ significantly among the twenty-two 
cooperating schools when they were grouped by 
district and size. Thus it was concluded that the 
differences observed among districts and between 
sizes could have occurred by chance and that these 
students belong to the same population with re- 
spect to their abilities as measured by these two 
tests. 

Population means and standard deviations for 
the Cooperative and the Iowa Reading Tests are 
shown in Table VII. 

It was hypothesized that the reading ability of 
twelfth-grade students did not differ significantly 
with respect to the size and location of the Schools 
they attended. The results of the analysis of var- 
iance for each of the reading tests andthe signif- 
icance of the obtained F values are Shown in Ta- 
ble VIII. 

The reading ability of tw elfth-grade students 
аз measured by the Cooperative and the Iowa 
Reading Tests did not differ significantly am ong 
districts but did differ significantly between large 
and small schools. Therefore, it was concluded 
that the differences between large and small 
schools probably did not occur by chance and that 
the twelfth-grade students in large schools belong 
to a different population with respect to the Coop- 
erative and the Iowa Reading Te sts. Means and 
standard deviations are shown in Table IX for 
twelfth-grade students onthe Cooperative and Iowa 
Reading Tests by large and small schools. 

Comparison of Book Readability with Student 
Reading Ability. In order to determine how ap- 
propriate vocational agriculture reference books 
are for the students who use them, comparisons 
were made on the basis of the readability grade 
levels of reference books as determined by the 
Dale-Chall formula and the grade levels of read- 
ing ability of students as measured by the Coop- 
erative and Iowa Reading Tests. Both mean and 
standard deviation grade levels were used in these 
comparisons. Figure 1 shows these means and 
standard deviations graphically. 

The upper portion of Figure 1 presents the data 
regarding ten agricultural reference books. Each 
bar in this portion of the figure shows the mean 
and the range, minusoneto plus one standard de- 
viation, in grade levels of book readability. For 
example, the first bar in Figure 1 shows that the 
book, Your Farming Program, has eighth-grade 
ies readability and that two-thirds of the read- 
ing material in this book falls between 6. 4 and 
9. 6 grade levels. | : | 

The lower portion of Figure 1 graphically pre- 
sents information that was shown in Tables ШОЛУ, 
V, УП, and IX about the reading ability of stu- 
dene Each bar inthis portion of the figure 
shows the mean and the range in grade levels of 
student reading ability from minus one to plus one 


standard deviation. Thus, the ninth-grade stu- 
dents of vocational agriculture in the twenty-two 
cooperating schools had mean general reading 
ability of grade 7. 5 as measured by the Cooper- 
ative Reading Test and two-thirds of these stu- 
dents had a reading ability rangeof grade 5. 0 and 
10. 0. 

It will be noted that the mean reading ability 
of students for each grade level was higher when 
measured by the Iowa Reading Test than when 
measured by the Cooperative Re ading Test. It 
will also be noted that mean student reading abil- 
Ну was higher for each succec ding high-school 
grade except for twelfth-grade students in the 
large high schools. However, reading ability, as 
measured by these tests, fails to increase a full 
grade level for students in each succeeding high- 
School grade. 

Since there was significant interaction among 
Schools with respect to the Iowa Reading Test 
Scores for tenth-grade Students, it was not per- 
missable to pool these scores for all tenth-grade 
Students. To show the extreme range of reading 
ability of tenth-grade Students, the highest and 
the lowest means and their respective standard 
deviations are shown in Figure 1. 

In general, Figure 1 shows that the means for 
book readability are higher than the means for 
Student reading ability. Thegrade level means 
for the ten books studied range from grades eight 
to eleven with standard deviations ranging from 
1.6 to 2.7 grade levels, The student grade level 
means for scores onthe Cooperative Reading Test 
range from 7.5 to 9.9 with st andard deviations 
ranging from 2.5 to 3,3. 

In the following paragraphs the readability of 
the books as measured by the Dale-Chall formula 
will be compared with the reading ability of voca- 
tional agriculture stud ents as measured by the 
Coo perative and the Iowa Reading Tests. Both 


2 а Score equal to the me- 
dian score made оп this test by students in the 
publisher's norm groupwho were halfway through 
their ninth year ofschool. Ninth-grade readabil- 
ity implies that the reading material can be read 
by students who are halfway through the ninth 
grade. These comparisons are presented sepa- 
rately for each of the four high-school grades. 
Figure 1 shows that all ten of the books studied 
have mean readability scores above the mean 
reading ability for ninth-grade students as meas- 
ШЧ by the Cooperative Reading Test, Although 
these same students Scored a grade higher on the 
Iowa Reading Test, nine of the ten booksare still, 
on the average, too difficult for these ninth-grade 
students. 
_ The overlapping of standard deviation bars in 
in Figure 1 shows that while the most able ninth- 
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TABLE VI 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY ELEVENTH-GRADE 


STUDENTS OF VOCATIONAL AGRICULTURE 


Source of Weighted Sums Mean Significance 
Variance of Squares d. f. Square of F Value* 
Cooperative Reading Test 
District 1366. 0296 10 136. 6030 N.S 
Size 254.10000 1 254. 10000 N.S. 
Interaction 1946. 477 10 194, 6477 N.S 
Within 16080. 218 156 103. 0783 
Iowa Reading Test 

District 69. 6304 10 6. 9630 N.S 

Size 47, 3594 1 41. 3594 N.S 
Interaction 388. 313 10 38. 8373 N.S 
Within 3777. O77 158 23. 9056 


*N.S. indicates that the observed F was not significant at the . 05 level. 


TABLE VII 


STANDARD DEVIATIONS FOR THE COOPERATIVE AND 


E ^ READING TESTS FOR ELEVENTH-GRADE STUDENTS 
IN TWENTY-TWO SCHOOLS 
Mean Grade Levels of 
Test Grade Level Standard Deviation 
ests 
А i 9.1 2.6 
Cooperative Reading 10.0 3.0 


Iowa Reading 
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TABLE VIII 


TWO-WAY ANALYSIS OF VARIANCE OF READING SCORES MADE BY TWELFTH-GRADE 
STUDENTS OF VOCATIONAL AGRICULTURE 


Source of Weighted Sums Mean овое 
Variance of Squares а. f Square of F Value 

Cooperative Reading Test 
District 1127. 5896 10 112. 2590 М. 5. 
Size 880. 5533 i 880. 5533 P <. 01 
Interaction 1015. 1126 10 101. 5113 N.S 
Within 14384. 024 132 108. 3693 

Iowa Reading Test 

District 423. 3408 10 42. 3341 N.S. 
Size 138. 4966 1 138. 4966 р <.05 
Interaction 232. 851 10 23. 2851 N.S 
Within 4422. 243 132 33. 5018 
*N, S. 


indicates that the Observed F was not Significant at the . 05 level. 


ENTS SHOWN BY LARGE 
AND SMALL SCHOOLS 
Large Small 
Mean Grade Level Mean Grade Level 
miss Grade Level of S. D. Grade Level of S. D. 
Cooperative Reading 9.0 3.3 9.9 d 
—— чи 10.3 4.2 


11.2 3.7 


~~. жайын 
dian ee лл, 
P _ .— S 

- чє I— — нн 

SS D. ——Á D iae 

a 
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FIGURE I 


GRAPHIC ILLUSTRATION O 
F MEANS AND STA 
== NDARD DE 
HA А рт OF TEN AGRICULTURAL ТЕНКА E RH AND 
Do LITY OF VOCATIONAL AGRICULTURE ит T 
BY THE COOPERATIVE AND IOWA READING uy m 
STS 


456 7 8 9 10 11 12 13 14 15 16 


Readability of Book! 


Gemma небо > 


Reading Ability? of Students in: 


Ninth Grade 


Iowa 


Tenth Grade 
Cooperative : 
Iowa— Lowest School —— 

—Highest School [om ML | 


Eleventh Grade 
Са ud 15 


Iowa 
Twelfth Grade 
Large Schools- 
Cooperative - q 
Jowa - i 
Small Schools- » Е] | 
Cooperative | Е 
Iowa L — | 
а 5 6 17 8 9 10 11 12 13 14 15 16 


lTitles of these ten books are found in the list of books at the end of this study. 
2Reading ability as measured by the Cooperative and the Iowa reading taste preyiquely desoribed, 
Since no pooling was permissable here, only the extreme schools are shown. 
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grade readers can be expected to read all but the 
most difficult portions of these ten books, the 
least able readers couldbe expected to read only 
the easiest portions of books A and B. 

It is shown in Figure 1 that nine of the ten 
books have mean readability scores higher than 
the mean reading ability scores for the tenth- 
grade students as measured by the Cooperative 
Reading Test. When compared to mean reading 
ability as measured by theIowa Reading Test, the 
average reading ability for each of the ten books 
exceeds the lowest tenth-grade class mean and is 
exceeded by the highest tenth-grade class mean. 

The standard deviation bars show that the most 
able tenth-grade students can be expected to read 
a major part of the material in each of these ten 
books and that all but the poorest readers can be 
expected to read selected portions of these books. 

Figure 1 shows that the mean read ability of 
two of the ten books was below the average read- 
ing ability of eleventh-grade students and of 
twelfth-grade students in large schools as meas- 
ured by the Cooperative Reading Test. 

Eight books were above their reading ability. 
When reading ability was measured by the Iowa 
test, only half of the books were too difficult, and 
two were somewhat too easy for these students. 

The standard deviation bars indicate that the 
more able readers in the eleventh grade and in 
the twelfth grade of large schools can be expect- 
ed to read all except the most difficult portions 
of these ten books and that these students will 
possibly find much material in books A through E 
too easy. The poorest eleventh-grade readers 
can be ex pect ed to read most of books A and B 
and the easier portions of the other eight books, 
while the least able twelfth-grade readers in large 
schools will probably experience difficulty in 
reading any of these books. 

Figure 1 shows that the twelfth-grade students 
in the small schools de monstrate reading abil- 
ity about one grade level higher than the twelfth- 
grade students inlarge schools. When compared 
on their Cooperative Reading Scores, the ability 
of these students was above the mean readability 
of books A and B; was about equal to the read- 
ability of books C, D, and E; and was one grade 
level below the means for books F through J. On 
the basis of their Iowa scores, these students had 
average ability slightly abovethe mean readabil- 
ity for each of the ten books. 

When the standard deviation bars for the books 
were compared with those for the twelfth-grade 
students in sm all schools, Figure 1 shows that 
the most capable readersinthis group can be ex- 
pected to read practically а11 of the material in 
the ten books with ease. However, these books 
contain few portions whichthe least able readers 


can read. 


Conclusions and Implications 


The following conclusions were drawn on the 
basis of reading ability data obtained from the vo- 
cational agriculture students in cooperating 
Schools and readability data from reference books 
Selected from tne librariesofthose Schools. Inthe 
interpretation of these conclusions, one should be 
mindful of the limitations imposed by the design 
and measurements used in this study. 

1. Each ofthe vocational agriculture reference 
books had a mean readability appropriate for stu- 
dents of average reading ability inone of the four 
high-school grades. 

2. Twelfth-grade students, especially those in 
large schools, were characterized by their low 
reading ability. 

3. Ingeneral, reading ability did not differ 
with respect to school size and location. 

4. In general, verbal mental ability did not dif- 
fer with respect to school Size and location. 

9. Nonverbal mental ability varied widely 
among individual schools. 

6. Reading ability varied widely both among 
vocational agriculture classes and within classes 
at a given grade level. 

7. Students of vocational agriculture scored 
from one to two grade levels higher on the Iowa 
Test of Reading in the Natural Sciences than they 
did on the Cooperative General Reading Test. 

8. Vocational agriculture students had mean 
reading abilities which ranged from zero to three 
grade levels below their peers оп the basis of 
publisher's norm groups. 

9. Although there was wide variation from 
School to school in the mental ability of vocation- 
al agriculture students, in general, their mental 
ability was similar to that of their peers as rep- 
resented by publisher's norm groups. 

10. In general, the agricultural reference 
books used by the Students of vocational agricul- 


ture tended to be too difficult for their reading 
ability. 


The findings and conclusions of this study ap- 
pear to have several implications for workers in 
the field of edu cation. These are listed as fol- 
lows: 

1. It seems apparentthat if a single vocational 
agriculture textbook were Selectedforuse by stu- 
dents in a given £rade, some students would ex- 
perience difficulty reading any but the most read- 
able portions and some would find all but the 
most difficult portions distressingly easy. There- 
fore, it seems desirable to use a variety of ref- 
erence materials with varied readability in each 
agricultural subject area, 

2. Teachers cannot assume that a student is 
an average reader because he possesses average 
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mental ability. 

3. When authors and publishers prepare 
agricultural reference books, they should give 
Special attention to book readability and the 
reading ability ^f vocational agriculture stu- 
dents. 

4. The fact that vocational agriculture students 
consistently scored higher onthe test of ability to 
read natural science materials thanon the general 
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THE MODEL of good penmanship has remained 
the same throughout the United States for many 
years, despite the fact that the methods used to 
teach hand writing have undergone considerable 
change. Asa result, this basic handwriting model, 
which has been called the «« већоо]-сору'' model 
by Lewinson and Zubin (6), may be used as a 
yardstick to evaluate the tendency of individuals 
to deviate from what they first learned. 

Everyone who writes has deviated somewhat 
from the “всһоо1-сору” form by altering the forms 
and size ratios of his letters in an idiosyncratic 
way. It is for this reason that signatures can be 
accepted as legal identification all over the world. 
Furthermore, it is the fact that each individual 
learns to write in a unique but consistent way 
Which underlies the science of graphology. 

Two essential reasons that each individual de- 
parts from the “всһоо1-сору” form are to achieve 
efficiency and speed. Naturally, the demand for 
legibility remains even after the demand for righ 


reconstruction of the school-copy form is relaxed. 
Typically, handwriting is not taught to students 
Over 14 years of age and thus, it is then that the 
tendency to vary accelerates. Many students 
crystallize their own writing styles in high school 
or, perhaps, incollege when they are called upon 


to at high speeds. 
take lecture notes 5 departs {гот the 


If handwriting typically 
School-copy model, what thenis reflected in those 
adult handwritings which closely adhere 2 sd 
than depart from, the school-copy mode 


d- 
с as cases of arrested han 
wl 22 хет тү ја seem to follow that 


Writing development it wou 
Such handwritings may also r ipee МЕ arrested 
intellectual and/or emotional deve өреп. 

Ina recent study, Epstein and Hartford (9 
found that ina group of male medical m c 
retention of the superfluous initial преке 


*All footnotes will be found at end of article. 


the letters u, v, w, and yl was, infact, related 
to emotional immaturity. In another recent un- 
published study, Linton, Epstein and Hartford 
found the use of these initial upstrokes to be as- 
sociated ** with relative inadequacy and lack of en- 
ergy inintellectual functioning and other forms of 
coping with the environment. .. "' 

In our survey of earlier graphological studies, 
we can find but few studies dealing with the rela- 
tionship between handwriting and intelligence in 
adult subjects. 

Thorndike (11) and Omwake (7) have reported 
virtually zero correlations between scales of 
handwriting quality? and adultintelligence. These 
results, in effect, indicate the lack of relation- 
ship between adult intelligence and conformity to 
such school-copy values as legibility, aesthetic 
appearance, and neatness. In children, however, 
since they learn to write while under strong ex- 
ternal pressure to conform to the school-copy 
model, correlations of about . 30 have been found 
by Gesell (5) and Starch (10) bet ween ratings of 
handwriting quality and general scholarship. 

The Thorndike and Omwake studies, in having 
established that adherence to school-copy values 
in adult handwritings is not positively related to 
intelligence, raised the further question of what 
departures, if any, from the school-copy might 
be associated with intelligence in adult subjects. 
A study perfor med by Castelnuovo- Tedesco (3) 

intsthe way. Heinstructed six untrained judges 
to rate 100 adult handwritings for intelligence and 
originality, separately, and then correlated these 
ratings with I. Q. scores. As criteria for intel- 
ligence, the judges were told to use aesthetic 
spacing, handwriting speed, and the simplifica- 
tion (and/or) deviations of the letter forms. They 
were told to use as the main criteria for judging 
originality «the extent to which the writer of a 
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TABLE I 


5, d, AND f VARIANTS AND THE FREQUENCY AT WHICH THEY OCCUR 
AT LEAST ONCE IN A WRITING SAMELE 


(N - 150) 
g d [ 

Variant 1 Variant f Variant f 
4 13 d 6 / 21 

Y 19 E 7 | 21 

? 34 4. 25 4 31 
ar 50 di 66 f 43 
f 60 9 129 7 66 

4 74 d= 136 f 95 
f£ 143 f * 137 


*5сһоо1 сору 
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given script has followed, in the process of writ- 
ing a specific letter, а different-writing- pattern 
from that which ће was probably taught in school." 
These correlations were all at least . 50, and 
since 100samples were rated it is extremely un- 
likely that the obtained relationships came about 
as a result of sampling errors. 

The only other study in which judges were suc- 
cessful in predicting handwriting from intelligence 
is that reported by Binet (2). He used profes- 
Sional graphologists. Unfortunately, however, 
the handwriting criteria upon which these graph- 
ologists based their predictions have not been in- 
dicated. 


In the present study, our purpose was to ex- 


plore the relationship of particular deviations 
from the school-copy letter forms to the educa- 
tional level, the I. Q. and the age of a group of 
female writers. 


Samples of the writing of 150 female clients 
were selected from the files of the NYU Testing 
and Advisement Center. An examination of them 
Suggested three letters as worthy obje cts of in- 
vestigation because they permitted wide grapho- 
logical variations within the three handwriting 
zones—upper, middle and lower, without .w 
identity. These letters Were 8, d, and f. bs 
more predominant script variations of these let- 
ters within our sample were then noted. 

In addition to the school-copy form, there were 
five form variants of the letter d, six form - 
ants of the letter g, and Six of the letter T tus 
purposes of analysis, the appearance of à уе: 
One instance of a particular letter varian ра 
Writing sample was consider ed ae to E 
Scribe that variant as present in this sample. ead 
each variant of the letter g, d; and 1, the ш 
Of samples in which it was present was gie 
mined. For instance, the school-copy 5 app да 
at least once іп 143 of the 150 writing ралар em 
Table I presents the form variants for eac eh 
letters and the number of Ss who used eac 


ant at least once. - 
The experimenters also were = ire 
ditional handwriting phenomenon. word “ОР” 


i i i the 
Omized in a special way in writing 
age stroke norm 


They would convert the up мө 
1 i the initial up- 
round off the letter o directly into Ш aito p 


бетіне ей тачан нна. ЕЕ shown in Ta- 
Omenon for separate study and = ^. of samples 


ts the num 
at least once. 

d the highest 
ere recorded. 
d the median а 


кеп wid 
ae ence Scale 


ble II, which also presen 
11 which it was present 
t Тһе ages, 1.0.'5 an 
ained by the subjects У 
yeu from 15 to 55 an 

ars. Тһе 1.0. scores, W s 
Scores on би Wire isa Bellevue Intelli£ 
ог the Wechsler Adult Intelligence 


Scale, ranged 


TABLE II 


“ОГ? CONNECTIVE AND THE FREQUENCY AT 
WHICH IT OCCURS AT LEAST ONCE IN A 
WRITING SAMPLE 
(N = 150) 


Variant T 


(47 в 


{гот 80 to 145. The median L Q. score was be- 
tween 124 and 125. It was decided to use 125 as a 
cut-off point for various statistical tests. 

As for educational level, the subjects at the 
lowest level had completedthe eleventh grade, and 
the subjects at the highest level had completed 
more than four years of college (Table Ш). Тһе 
subjects were divided into two groups on the basis 
of grade completed, one group consisted of those 
who had gone no further than the twelfth grade (the 
first two groups on Table II), and the other con- 
sisted of those who had goneto college for at least 
some period. 

In sum, the distributions of scores on three 
variables, age, I.Q. and grade completed, were 
dichotomized for purposes of doing statistical 
tests. The best approximation of the median was 
used as the cut-oft point in each case. 


Characteristics of the Sample 


А preliminary analysis of the criterion vari- 
able was made to throw light on the nature of the 
sample. The correlation between age and educa- 
tion was . 42. The vast majority of subjects were 
still in school so that this correlation was to be 
expected, since educational level depends upon 
age among subjects who are of school age. 

The correlation between age and І. 0. was .27. 
The older subjects in the sample were predomin- 
antly those who had continued their education be- 
yond the period of compu lsory attendance. Un- 
doubtedly such subjects are mainly from the upper 
intelligence range, sothere was a selective factor 
in favor of high LQ. scores at the upper age 
levels. The correlation bet ween education and 
LQ. was. 34 for the same reason. 


Results and Discussion 


e relationship of the d variant to age, educa- 
re presented in Tables IVa and IVb. 
he phi coefficients for the 


Th 
tion and I.Q. а 
Table IVa, containing t › 
тоге frequently appearing d variants, shows only 
one significant negative relationship, a negative 


one between ageandthe third d variant. (Signit - 
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TABLE III 


DISTRIBUTION OF THE HIGHEST GRADES COMPLETED 
BY THE 150 FEMALE SUBJECTS 


Number of 
Highest Grade Attained Subjects 
Eleventh grade or lower 26 
Twelfth grade 59 
Some college 85 
Four years of college or more 30 


TABLE IVa 


CORRELATION COE FFICIENTS OF d VARIANTS WITH 
EDUCATION, I. Q., AND AGE 


Variant Education I.Q. 


d .12 . 03 . 05 
4 . 04 -. 12 А 
a .09 .05 -.19* 
d 08 . 04 


*Significant at . 05 ог above. 


TABLE IVb 


CHANCE PROBABILITY FOR RELATIONSHIPS BE- 
TWEEN GREEK d, MODIFIED GREEK d, AND 
EDUCATION, 1. Q., AND AGE* 


Variant Education LQ. Age 
79 . 007 .181 .10 
3 ‚005 ‚356 2920 


*The one-tailed level of significance is read directly 
from the table. 
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icance is considered established at the . 05 level 
unless otherwise indicated.) Table IVb, contain- 
ing the exact probability ratios for the two infre- 
quently appearing d variants, shows each of these 
variants to be positively associated with educa- 
tional level at better than the . 01 level on a one- 
tailed test of significance. А one-tailed test was 
used becauseofthe suggestion in the literature of 
the relationship between these dforms and in- 
tellectual ability (8). (The exact probability ra- 
tios for age and 1.0. showed a positive relation- 
Ship between these d forms though this relation- 
Ship did not reach significance.) Because of its 
resemblance to the Greek alphabet delta, graph- 
ologists have traditionally referred to thed vari- 
ant presented first in Table IVb as the Gr eek-d. 
We shall refer to both of these variants as the 


Greek-d types. | 
The phi coefficients for the f and g variants 


are presented in Table V. The variants are or- 
dered so that the one having the most positive cor- 
relation with educational level is listed first and 
the variant having the strongest negative correla- 
tion is listed last. Table V also shows the phi co- 
efficients with I.Q. and age. Incidentally, the 
phi coefficient reflects the frequency of appear- 
ance of the variants as well as the strengthof 
their relationships to other variables, 50 that com- 
parisons should be made with caution. | 

Table V shows that there are three f variants 
which have significant positive associations with 
educational level, although none are significantly 
associated with I. Q. Among the g variants, ee 
have significant positive associations both 5 : 
educational level and I. Q. These are Тү шета 
as the figure-8 and half-tigure-8 g. The fig 


ifi iti iation 
8 asignificant positive assoc 
iste С ~ t is significantly and neg- 


With age. One g varian | 
atively associated both with age and educational 
1 

к. ation from the school- copy 


Considerable d e vi 


model is reflected in those d, f, and g variants 


sociated with higher ed- 
The question arises 
iate from the school-copy 
der these variants, first, 
degree of simplifica- 
e and, second, with 
c economy 


ucational level, I. ©. 
how these variants dev 
model. We shall соп510‹ 
iem respect to the аж 
ion which they have under p 
respect tothe relative degree of motori 
with which they are written. | 
Simplification is rated roughly ue а partielle 
much graphite or ink is used to M3 7 ^ used in 
lar variant, as compared with the am^ аға posi- 
the school-copy form. Among the A on ë 
tively associated with educatio nal = „АЈ“ 
Greek-type d's, first and ве va 
Table V and the half-figure-8 & all 
Siderable degree of simplification. оне 
fin Table V is among (ће least simplifie 


re 
ЧАТ, and the figure-8 g, elates mo 
Ehly with educational 19991, 


s of how 


cond f 
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any other single variant, is less simplified than 
the last g in Table V which is negatively associ- 
ated with age and educational level. It is appar- 
ent that simplification alone cannot account for the 
obtained relationships. 

Turning now to economy, in graphology, 
economy usually refers to the amount of energy 
and time which isinvolved in the writing. Hence, 
a letter form is judged more econo mical if less 
time elapses and less energy is utilized between 
the termination of the preceding letter and the be- 
ginning of the follo wing letter. An emphasis on 
rightward tending strokes, an avoidance of left- 
ward tending strokes, and a minimum of breaks 
and stoppages are therefore the key criteria. 

Thed, f, andg variants, withthe exceptionofthe 
second f on Table V, that were found to be signif- 
icantly associated with higher educational level, 
LQ. or age all show a high degree of economy. 
However, the second d in Table IVa, the fourth 
and fifth f variants in Table V, and the third and 
sixth g variants in Table V are also very econom- 
ical forms but not significantly associated with 
age, LQ. or education. Therefore, economy 
alone also cannot account for the relationships 
which were obtained. 

Beyond having undergone simplification and 
economization, those d, f, and g variants which 
were positively associated with higher education- 
al level, LQ. or age, also represent the most 
original deviations from the school-copy form. 
Considering the f variants from this viewpoint, we 
can see that nothing original has been evolved in 
any of the three variants following the school-copy 
one in Table V. The transformations from the 
school-copy have been mainly in the direction of 
simple omission—of either, or both upper and low- 
er loops. In each of the three f variants which 
were positively associated with educational level 
we see the emergence of a new form relative to 
the school-copy model. 

In the case of the figure-8 andthe half-figure-8 
forms, the transformation when compared with 
other g forms seems even greater than in the case 
of the f. It is interesting to note what the Amer- 
ican graphologist, Louise Rice (8) has said con- 
cerning the figure-8 g; ‘‘People who use this for- 
mation. . .have a certain amount of intuition and 
instinct; they arethe people who innately judge lit- 
erature and art fairly well, even though not trained 
for such judgments. . . This g also shows innate 

anding of humanity. '' 
woo middle zones of the Greek-d did 
not differ in as specific afashionfromtheir school- 
copy counterparts as didthe zonal elements of the 
higher f and g forms. Yet, the Greek-d types 
taken as Gestalten, seem to embody an aesthetic 
simplicity not found in the other d variants. Of 
the Greek-d, Louise Rice (8) has said, “Tt is not 
surprising to find stylists ашори E 5 к 
using this d exclusively, nor to fin at college 
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professors апа scientists innatelytaketoit. When 
found in ordinary writing, this formation is the 
‘straw in the wind’ which tells of the intellectual 
possibilities of the writer...." 

Turning now to the d and f variants which were 
negatively associated with age, and to the g vari- 
ant which was negatively associated both with age 
and educational level, we note that none of the 
three shows any evidence of originality. The f, 
Of course, is the school-copy model; the g variant 
may bedescribedas an **unfinished'' school-copy 
g, and the d variant is a som e what deteriorated 
ог inept school-copy d. 

Table VI reveals the ‘‘of-connective’’ to have 
a significant positive association to educational 
level, 1.0. and age. The direct conversion of 
the upstroke of the o into the initial upstroke of 
the f is a radically economical measure which 
transforms the separate letters into a unified, 


simplified Gestalt. 


TABLE VI 


CORRELATION COEFFICIENT OF “of” CON- 
NECTIVE WITH EDUCATION, I. Q., AND AGE 


Variant Education 1.0. Аве 


у е " Сы .23* .35* 


*Significant at . 01 level. 


Г riants which 
Among the twenty letter -form varian 
we have studied, only the figure-8 g and the half- 


figure-8 re foundto have a significant, posi- 
tive ad X cm with higher I.Q. The **of-connec- 
Чуе’? -the only connective form which we fei 
іп this study—was also found to be assoc iate 
with higher І. ©. At this point, we might wonder 
whether a comparably extensive study of other 
connective-form variants m ight yield a greater 
Number of significant positive corr elations with 
LQ. than we have found among letter-form var- 
lants, To the extent that the need to prodate a 
more or less legible script limits one 5 free um 
to forge new pathways, the li mitation may be 
Breater on the individual letter forms than on the 
modes of combining letter forms. 


Summary and Conclusions 


ter forms selected for 


Each of the small- let 
school-copy 


Study were writtenat least once in the 
manner by about 90 percent of our group of 150 
late adolescent and adult female Ss. In addition 
to the school-copy forms, we were able to clas- 
Sify five variantsofletterd, six variants of letter f, 


and six variants of letter g. Tnese variants ap- 
peared in far fewer hand writings than did the 
school-copy form. Also selected for separate study 
was a highly economical variation of the word “ог”. 

Among the d, f, and g variants, some adhered 
rather closely to the school-copy form and some 
deviated to a much greater extent. We found the 
school-copy f and one d variant to be significantly 
associated with lower age, and one g variant to be 
significantly associated with both lower age and 
lower educational level. Both the d and f variants 
departed only slightly {rom their school-copy 
counterparts. 

Among the seven letter-form variants which 
were shown to be associated with higher educa- 
tional level, there were two d variants, three f 
variants, and two g variants. Bothg variants were 
also associated with higher I. Q. and one, with 
higher age. Allseven of these variants are clear- 
ly set off from the remaining eleven variants in 
that they combine a high degree of motoric econo- 
my with the most radical and original departures 
from the school-copy form. They combine effi- 
ciency with creativity and can be con sidered the 
most highly evolved of all the variants we have 
studied. The special case of the of-connective, 
which is graphologically also a highly developed 
variation, was also found to be associated with 
higher educational level, higher І.0. and higher 
age. 

In effect, our results suggest that the female 
adult who continues to write in the fashion that 
would have pleased her elementary school teacher 
is less likelytobeas well educated, as bright, or 
as matureasthe adult who has worked her way out 
of the school-copy rut and has evolved a more ef- 
ficient and original way of writing. 

The results of the present study, in revealing 
that there is an evolutionary trend away from the 
school-copy model, have led us to wonder whether 
the values underlying the teaching of handwriting 
should be revamped. Instead of attempting to cast 
all children in the school-copy mold, perhaps the 
teacher should be taught to evaluate handwriting 
progress in the child with respect to the efficiency 
and legibility of his letter forms as they appear in 
the context of cursive writing. With this orienta- 
tion, the teacher may be less likely to make the 
error of diagnosing spontaneous, creative and 
economical deviations from the school-copy as an 
expression of poor progress. Why shouldn’t the 
child who, for one reason or another, can never 
be a facile copyist, be encouraged to persist in 
whatever unique modes of writing he discovers, so 
long as they are no less efficient nor legible than 
the school copy? It would seem that an early ac- 
ceptance by teachers of unique styles of writing 
would make writing more of a pleasure thana chore 
the child who is learning to write. More im- 
kelihood that many children might 
ted experiences of failure to write 


for i 
portant is the li 
be spared repeal 
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**correctly". Suchexperiences might be the pre- 
dominant cause of the immature, inept handwrit- 
ings that are seen in later years—handwritings 
which persist as foci of self-consciousness, em- 
barrassment, and shame. 


* 


FOOTNOTES 


The authors wish to expresstheir appreciation 
to Dr. Wallace Gobetz of the New York Uni- 
versity Testing and Advisement Center, whose 
cooperation made this study possible. 


** The Handwriting Institute, Inc., is a privately 


1 


2. 


supported researchorganization formed to in- 
vestigate graphological and graphomotor vari- 
ables, and to collate the research of others in 
this area. 


In learning the School-copy model, we are all 
taught, when we write words beginning with 
any one of these four letters, that our first 
Stroke should be an upstroke, originating at 
the base line. Since this beginning stroke is 
completely superfluous to the essential letter 
form, andsince it tends to reduce the efficien- 
cy and the fluency of the writing, people tend 
to omit it as they mature. 


Scales of handwriting quality such as those of 
Ayres (1), Thorndike (12), Rosenhaus (9), are 
commonly used in the eleme ntary schools to 
evaluate the individualchild's progress in cur- 
sive writing. The scales all typically consist 
of a graded series of handwriting samples, 
from worse to better, the best and highest 
grade sample always being an ideal school- 
copy model. 


11; 


12. 


. Starch, D. 
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A STUDY OF PATHOLOGICAL DOUBTING AS 
A RESPONSE SET 


VELMA I. RUST* 
University of Illinois 


FOR YEARS test makers have been concerned 
with designingtests which will measure accurate- 
ly knowledge of content, specific abilities or skills, 
personality traits, and so on. They are interest- 
ed in eliminating, or kee ping to a minimum, all 
extraneous effects caused by guessing, or mental 
Or attitudinal sets onthe part of the subjects. Val- 
idity is kept high by giving special attention to the 
wording of items, their arrangement, and keying. 

A few writers (3, 4) recently have raised ques- 
tions regarding the relationship between evidence 
of knowledge of content (inthe form of test scores) 
апа a tendency to be very hesitant about accepting 
any statement as proven. The author became 
interested in studying the res ponse set herein 
called pathological doubting. The definition of 
a pathological doubter used by Ennis (3) is the one 
also used here. According to him, a pathological 
doubter is a person who is not just cautious, but 
who will never accept anything as proven, a per- 
Son for whom ‘‘proo!”’, “sufficient evidence", and 
“warranted” are inapplicable inall conceivable 
Situations. 

The major purpose ofthis research was to test 
two hypotheses: 1. pathological doubters, chosen 
by the use of criteria based on their responses to 
Selected items of the Watson-Glaser Critical 


Thinking Appraisal consistently exhibit a pattern 
DE reasoning which differs from that of the other 
le; and 2. the presence of a 


Subjects in the sam p 5 
response set such as pathological doubting affects 
the apparent factor content of a test of critical 


thinking. 
Related Research 


Ennis (3) has considered the validity E D 
atson-Glaser Critical Thinking Appraisal ( er : 
after referred to as ће WG test) from a logica 
Point of view. He asserts that the items in Parts 
2, 3, and 4 of Form Bm of this test are keyed in 
Such a way as to favor the pathological doubter. 
His reasoning may be illustrated by referring to 


*The author is deeply indebted to Dr. Ke 
of Illinois for their assistance with the P 
The computations for this paper жег 
Laboratory of the University of Illinois. 


nneth B. Hender 
reparation of this article. 


e done on пас, 


Part 2 of the test, whichis entitled ‘‘Recognition 
of Assumptions” and includes items 21 to 36 in- 
clusive. For each item, the student is asked to 
decide whether a given statement ‘‘necessarily”’ 
assumes another given statement. Of the sixteen 
items in this part, only four are keyed ‘‘assump- 
tion necessarily made". Thus, the pathological 
doubter gets three-quarters of them right. Ennis 
then analyzes Parts 3 and 4 іп the same way and 
shows that in the whole test the consistent patho- 
logical doubter could get up to sixty-seven out of 
the total of ninety-nine items correct. He, there- 
fore, concludes that the keying so favors the path- 
ological doubter that it is possible for him to be 
placed at the eighty-sixth’ percentile if he merely 
always chooses the **doubting'" answer. 
Frederiksen and Messick (4) have written an 
article in which they describe how they attempted 
to score set and content aspects of atest situation 
separately. Threetests of the report-writing type 
were used. The three hy potheses tested may be 
stated briefly as follows: a) set scores from all 
three tests measure the same thing reliably; b) set 
scores are related to persona lity or other set 
measures; and c) content scores measure the same 
things reliably. The investigators also tried to 
discover whether it was *criticalness"' that the 
set scores measured, and whether verbal knowl- 
edge and reasoning were included among the things 
measured by the content scores. Frederiksen and 
Messick believethat if the answer to a question is 
affected by knowledge, itisas ifasubject mere- 


not 
lytosseda loaded coin. They, therefore, assumed 
dichotomous data and derived a simple formula 


for set scores and another forcontentscores. They 
obtained correlation coefficients of 0. 82 when they 
intercorrelated content scores, 0.96 when they in- 
tercorrelated set scores, and 0. 05 when they in- 
tercorrelated content and set scores. Thus they 
were successful in separating content scores from 


set scores. | 
The Illinois Curriculum Program Committee 


(12) carried out a Critical Thinking Project in 


son and Dr. Philip J. Runkel of the University 


an electronic computer of the Digital Computer 
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which a deliberate attempt was made to improve 
the critical thinking skills of a group of high 
Schoolstudents. In order to measure differences 
between experimental and control groups, three 
tests were used: Form Bm ofthe WG test, A Test 
of Critical Thinking, Form G, prepared by the 
American Council on Education (hereinafter called 
the ACECT test), and A Test on Principles of 
Critical Thinking, Form РІ. 5 (hereinafter called 
the PCT test), prepared by the Illinois Critical 
Thinking Project Committee. The major hypoth- 
esis that kno wl edge of the principles of critical 
thinking is related to the ability to evaluate argu- 
ments andassess conclusions drawn was not con- 
firmed. Moreover, low inte rcorrelations were 
obtained among the three critical thinking test 
Scores. The Committee, then, beganto think that 
the explanationforthis might be in tne measuring 
instruments themselves. 

The author (9,10), therefore, factor analyzed 
the item scores for these three tests. She used 
а sample 01587 students consisting of all students 
who had attempted all items on all three tests, 
and showedthattnis method of selecting the sam- 
ple did not create bias. Phi correlation coeffi- 
cients were computed and the centroid method of 
factoring employed. Factor analyses of the three 
critical thinking tests yielded only one weak gen- 
eral factor each. In view of the fact that intelli- 
gence tests, tests of psy cho motor and physical 
abilities, performance tests, and tests of occu- 
pational abilities have all yielded a thoroughly 
established general factor (within a given test), 
the finding т this case was rather surprising. 
Moreover, several investigators who have factor 
analyzed reasoning tests using procedures sim- 
ilar to that used by the author, have Successfully 
isolated several factors (1,2,5,6,8). The author 
suggested several explanations for her finding, 
one of which was that the population lacked ran- 
domness because of the presence of too many 
pathological doubters. It was thought possible 
that instructioninthe principles of critical think- 
ing had increasedthe subjects' tendency to be ex- 
tremely cautious. The present study was, there- 
fore, undertaken in the hope of learning more 
about the trait herein called pathological doubting. 


Method and Results 
MELOS deu тазалы 


Item scores on thethree critical thinking tests 
mentioned above for the same sample of 587 stu- 
dents were used. An attempt was made to isolate 
those subjects suspected of being pathological 
doubters. Ennis’ assertion that the items in sub- 
tests 2, 3, and 4 of Form Bm of the WG test are 
keyed to favor the pathological doubter led the 
author to use the scores of the subjects on these 
< sas the basis for dividing the 587 students 
item two groups, namely, pathological doubters 
i "€ Сп аочыды. Of the 65 items in subtests 2, 
an 


3, and 4, 520fthem are keyed as **assumption not 
necessarily made’’, **conclusion does not neces- 
sarily follow", or **conclusion does not follow be- 
yond a reasonable doubt". The author arbitrarily 
decided to accept getti ng more than 33 of these 
items correct as evidence of pathological doubting. 
The criteria used in selecting pathological doubt- 
ers, therefore, were: a) having at least 34 of the 
52 items keyed “assumption not made" or ‘“соп- 
clusion does not follow’? correct, and b) having no 
more than 19 errors among the 65 items. The 
Second criterion was added because it was thought 
that students who were making many errors, and 
especially if they were making errors of opposite 
kinds, were not consistent intheir thinking and, 
therefore, probably were confused and perhaps 
Just guessing the answers. These criteria yielded 
а group of 262 pathological doubters, anda group 
of 325 non-doubters. 

Item scores for these subjects were available 
for Form Bm ofthe WGtest, Form G of the ACECT 


itemsofthesethreetests were divided into 21 sub- 
tests. The items of the WG test have been grouped 
by the test makers into fi ve parts: Inference (20 
items), Recognition of Assumptions (16 items), 
Deduction (25 items), Interpretation (24 items), 
and Evaluation of Arguments (14 items), The 52 
items of the ACECT test and the 53 items of the 
PCT test were £rouped on the basis of natural 


Scores for the groups of pathological doubters and 
non-doubters were obtained, 

Testing Hypothesis 1. — Pathological doubters 
chosen using criteria bàsed on their responses to 


other subjects in the sample. 
Mean subtest scores were computed for the 


262 pat hological doubters and for the 325 non- 
doubters. 


and that for the group of non-doubters, for each of 
the 21 subtests, was tested for significance. In 
each case the Variance was pooled and a t-test was 


mean subtest score Гог (ће 262 pathological doubt- 
era and thet Tor the 325 non-doubters was Sigil 
cantly different from zero beyond the . 01 level of 


i a „тне 


significance. Differencesof means were found to 
be significantly different from zero at the . 01 
level for nine of the ten X? tests made. In the 
case of subtest 20 again, the difference was not 
significant. Table I summarizes these findings. 

А second method was used to test this hypoth- 
esis. Answerstoitems 1 to 20 in subtest 1 of the 
WG test were scaled according to whether they 
gave positive or negative evidence of doubting. 
The scaling of these responses and the subsequent 
analysis were undertaken on the reasoning that 
people who give the doubting answer to some items 
(for example, those in subtests 2, 3, or 4) will 
give doubting answers to these items also. In 
subtest 1, whichis called **Inference"' by the test 
makers, a subject is requiredto label a statement 
as definitely true (T), probably true (PT), having 
insufficient data (ID), probably false (PF), or 
definitely false (F). The scale value allotted а 
subject for an item depended upon the keyed an- 
swer and the response given. Table П indicates 
how the various answers were scaled. This pro- 
cedure may be illustrated by reference to item 2, 
which is keyed as probably true, and to a three 
point scale consisting of the points T or F, PT or 
PF, andID. A person who is prone to accept 
statements as true without critically analyzing 
them might respond true. On the three point 
scale, this is one place to the left of the keyed re- 
sponse and indicates ready acceptance ofa state- 
ment rather than a tendency to doubt. The answer, 
therefore, is givena scale value of -1. Are- 
sponse of ID is one place to the right of PT and 
indicates a tendency to be even more doubtful than 
the test makers consider warranted. Such are- 
sponse was allotted a “doubting”? value of +1. 
Other scale values were determined in a similar 
way. For each subject a score was allotted for 
each of the 20 items 01 subtest 1. An overall 
doubting index was thus obtained for each subject 
by adding the 20 scores. The mean doubting score 
for the group of 262 patholo gical doubters was 
compared with that for the group of 325 non- 
doubters, using a t-test. | 

The scaling procedure outlined in the preced- 
ing paragraph was repeated, exceptthat in obtain- 
ing a doubting score for an item four additional 
Scale values were also included. These are list- 
ed in the last four lines of Table IL The thinking 
behind this revision was that the direction of er- 
ror does not matter; all that is of interest here 
is whether or not a subject chooses a “doubting 
answer. Again, а t-test was used to test the sig- 
nificance of the difference of mean doubting Scores 
of the two groups. 

When the mean doubting index for the group of 
262 pathological doubters (0.50) was com pared 
withthat for the groupof 325 non-doubters (-0.31), 
at value of 2. 89 wasobtained. When the revised 
Scaling method was used, the difference between 
the mean doubting indices for the groups of 262 
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and 325 subjects (0. 64 and -0. 09 respectively) 
yielded а t value of 2.46. Thus the mean differ- 
ence is significantly greater than zero beyond the 
.01 level of significance in thefirst case, and be- 
yond the . 02 level of significance in the second 
case. 

Testing Hypothesis 2. — The presence of a re- 
sponse set such as pathological doubting affects 
the apparent factor content of a test of critical 
thinking. 

A factor analysis of item scores for the WG test 
was carriedout forthe group of 325 non-doubters. 
Since the data were dichotomous, inter-item phi 
correlation coefficients were computed. The cen- 
troid method of factoring the correlation matrix 
was employed, and ones were placed in the diag- 
onal cells of the matrix. The findings were com- 
pared withthe results obtained by the author (9, 10) 
for the original sample of 587 which consisted of 
all subjects involvedinthe Illinois Critical Think- 
ing Project who took all three critical thinking 
tests and who attempted all items on all three 
tests. Item scores for the PCT test were also 
factor analyzed using the same procedure. 

As was the case in the author's original re- 
search (9,10), no strong general factor was ob- 
tained for either the WG,or the PCT test, when 
item scores for the 325 non-doubters were factor 
analyzed. Inthecase of the WG test the first cen- 
troid factor accounted foronly 4.90 percent of the 
variance. For the PCT test this figure was 5. 48 
percent. For this reason, item scores for the 
ACECT test for the group of 325 non-doubters 
were not factor analyzed. 

A factor analysis of subtest scores for the 21 
subtests of the three critical thinking tests was 
carried out for the original sample 01587 subjects. 
Similar factor analyses were made for the group 
of 262 pathological doubters and the group of 325 
non-doubters. Pearson product-moment correla- 
tion coefficients were computed. Unities were 
placed inthe diagonal cells of the correlation ma- 
trix. Centroid factors were obtained and an at- 
tempt was made to rotate these factors to oblique 
simple structure using the oblimax procedure. 

These factor analyses of subtest scores yielded 
one rather strong general centroid factor for each 
ofthe three samples. Here the first centroid factor 
accounted for approximately 32 percent of the var- 
iance in the case of the total sample of 587 sub- 
jects, 21 percent in the case of the 262 patholog- 
ical doubters, and 22 percent in the case of the 
325 non-doubters. Table III shows the variance 
accounted for by the first four centroid factors in 
the case of all three samples. Use of Guttman's 
*«1ower bound for the number of common factors” 
(7) indicated that an attempt should be made to ro- 
tate four factors to oblique simple structure in 
each case. The oblimax method of rotation was 
employed. This yielded quite high factor loadings, 
that is, high for reasoning factors. However, the 
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TABLE I 


Mean for 262 


Test and Pathological Mean for 325 
Subtest Doubters Non-Doubters t* жаж 
Watson-Glaser 
1 12.81 10.49 6.26 
2 12.22 9. 70 16. 16 
3 21,45 14. 99 7. 87 230. 00(1)** 
4 IT, 52 14. 02 8.18 
5 10.20 8.22 8. 28 
ACECT 
6 5.54 4.74 7.15 
7 2.33 1.41 5.38 87. 52 (2) 
8 4. 37 3. 09 13. 66 
9 3. 4" 2. 64 9. 49 
10 8.13 6. 66 7. 69 50. 79(2) 
11 2.46 1.78 8.87 51. 92(1) 
12 2.20 1.33 10. 33 68. 25(1) 
13 7. 60 6. 22 9.99 46. 24(2) 
14 4.26 3. 29 6. 36 45. 04(3) 
Principles 
15 4. 38 3. 75 6. 70 21.57(2) 
16 4.54 3. 97 5.08 
17 3. 42 2. 19 5.27 
18 4. 45 3. 59 7.07 
19 7.06 5.52 9.07 
90 .89 . 79 1. 36 7. 08(3) 
21 5.41 3.98 9.77 


ж АП values of t and X? are significant beyond the one 
**x? yalues were computed where the distributions we 
freedom are given in parentheses. 


percent level, except those for subtest 20. 
Te not normal. Numbers of degrees of 


| 
| 
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TABLE II 


SCALE FOR OBTAINING A DOUBTING SCORE FOR ITE 
MS1T 
WATSON-GLASER TEST БРИН 


Evidence of Doubting 


Positive Negative 
> Items poe m Ея и 
Original Method of Scaling: 
T 1,11 РТ 1 
T 1.17 ID 2 
PT 2,9,16 ID 1 T E 
ID 3,5,7,8,11, 12, 
14,18 m " 
ID 3, 5, 7, 8, 11, 12, 
14,18 oe а 
1 3,5,7,8,11,12, 
14,18 РТ а 
ID 3,5, 1,8,11,12, 
14,18 T -2 
F 4,6,13,19 PF 1 
Е 4,6,13,19 ID 2 
PF 10, 15, 20 ID 1 F " 
Revised Method of Scaling 
ur = AM „и à 
F 4, 6,13, 19 РТ 1 
РТ 2,9,16 Е -1 
PF 10, 15, 20 T E 


* :ation T stands for definitely true, PT for probably true, ID for insuffi- 
e UN рарју false, and F for definitely false. 


cient data, PF for pro 
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TABLE III 


THE VARIANCE ACCOUNTED FOR BY THE FIRST CENTROID 
FACTORS WHEN THE 21 SUBTEST SCORES ARE 
FACTOR ANALYZED 


Percent of Variance Accounted For 


Pathological 


Centroid Total Sample Doubters Non-Doubters 
Factor N - 587 N - 262 М = 325 
I 31. 53 21.14 22.13 
II 5. 48 6.15 6. 00 
ш 4.55 5. 74 5. 48 
IV 4. 36 5. 27 4. 86 


oblimax solutions forthe three samples жеге dif- 
ferent. They are shown in Table IV. 


Conclusions 


The findings showthe performance of the path- 
ological doubters to be definitely and consistently 
superior to that of the non-doubters. They also 
show that those subjects who tend to choose a 
doubting answer insubtests 2, 3, and 4, also ex- 
hibitthe same tendency when responding to items 
in subtest 1. There is, therefore, sufficient ev- 
idence to state that the pathological doubters do 
consistently exhibit a pattern of reasoning differ- 
ent to that of the other subjects in the original 
sample of 587, and thus to accept Hypothesis 1. 
One can also conclude that the doubters were suc- 
cessfully separated from the non-do'ibters using 
the author's arbitrarily chosen criteria which 
were basedon Ennis' comments regarding the WG 
e is particularly interesting to note that the 
pathological doubters consistently made higher 
scores than the other subjects on all subtests. 
Perhaps subtests 2, 3, and 4 in the WG test are 
not the only ones keyed to favor the pathological 
doubter. Onthe other hand, perhaps the patholog- 
ical doubter’s tendency to use extreme caution 
about accepting statements indicates that he can 
evaluate arguments, knows the rules of logic, rec- 
ognizes unstated assumptions, and can invent and 
evaluate hypotheses, which are some of the skills 
the three critical thinking tests were designed to 
measure. 

Subtest 20 in the PCT test seems to differ from 
the other subtests. It consists of three items 
only, and its mean item difficulty when computed 


for the sample of 587 was found to be only 0. 28. 
These facts may account for the difference. 

Seventy-two percent of the original sample of 
587 students were inthe experimental group, Sev- 
enty-nine percent of the group of 262 pathological 
doubters were fromthis group and only 66 percent 
of the non-doubters. Thus, there is some evi- 
dence that instruction in the principles of critical 
thinking increases the tendency to be overly cau- 
tious and to choose a ‘‘doubting” answer. 

_ When item scores were factor analyzed, only 
slight differences were observable between the 
group of non-doubters and the whole sample of 587. 
No strong general factor was obtained in either 
case for either the WG ог the PCT test. In con- 
trast, when subtest scores were factor analyzed, 
four factors were Obtained, perhaps because sub- 
test scores are more significant and reliable than 
item scores. Differences in factor content, how- 
ever, were apparent. Analysis of the factor load- 
ings given in Table IV shows that the factors ob- 
tained for the three samples (the 587, the 262 
pathological doubters, and the 325 non-doubters) 
are not sufficiently alike to be considered the 
Same. Not even one factor common to the three 
Samples hasbeenfound. There is, therefore, €V- 
idence here to support the hypothesis that the ргев“ 
епсе of a response set such as pathological doubt- 


ing affects the apparent factor content of a test ud 
critical thinking. 
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GEOMETRIC AID IN TEACHING RECTILINEAR 
CORRELATION 


JOHN GAITO 
Lake Forest College 
Lake Forest, Illinois 


THE PURPOSE of this paper is to prese nta 
simple geometric aid Гог use in the teaching of 
rectilinear correlation. 

The coefficient of correlation may be concerned 
with the relationship between a number of variables. 
In the materials to follow, the concern will be 
with just two variables, X and Y. A convenient 
means of indicating the concept of correlation is 
by a diagram in which the X variable is plotted on 
the horizontal axis and the Y variable on the ver- 
tical axis. If the points within the axes scatter in 
an upward direction from left to right, in a manner 
which indicates that X and Y tend to vary together, 
a positive correlation is present. If the scatter is 
downward from left to right, а negative correla- 
tion is present, indicating that X and У tend to vary 
inversely. If there appears to be no trend pres- 
ent, then zero correlation is indicated. 

А convenient Way ofteaching rectilinear corre- 
lation is to consider the scattering present as de- 
Scribing an ellipse. Ап ellipse is completely de- 
fined by its major and minor axes. The m nios 
axis is the long axis, and the mino r axis E : e 
short axis. An ellipse varies in shape with two 
interesting limiting cases. One limit occurs 
the major and minor axes are equal; then the fig- 


i i is when the 
ure is a circle. 5 


The other extreme 18 1 th 
minor axis is equal to zero and the major axis 1S 
finite, in which case 


we have a straight m. 

i i lation chart 
First, plot the points on the corre t, 

or ағына diagonal Thus one obtains an appini 
imate elliptical figure by drawing a curve ш 
encloses most points and passes through aime о 
the outer points. Next draw a single straight line 
through the long axis 


of the figure. This ET po 
resents the trend of the scattering points. 
descriptive purposes this can be handled на 
by inspection of the scatter and crudely drawing 2 
line by hand. (A more precise method ча, E 
to draw the lines representing the regression 5 | 
on X and X on Y, and then to use а line which is 
intermediate between the two to represent the 
trend.) This line would be the major [s € 
ellipse. The minor axis would be a line dra 
perpendicular to this 


line at its center. | 
Having drawn the 5С attering of the points to 
represent an ellipse, 


we then determine the mag- 


nitude ofthe relationship. This magnitude could 
be determined exactly by an appropriate formula 
available. The approximate magnitude, however, 
could be ascertained by looking at the ratio of the 
minor axis to the major axis, provided the two 
axes are drawn to the same scale. As the minor 
axis goes to zero (orthe major axis gets very large 
relative to the minor axis), this ratio will also go 
to zero, and the correlation coefficient will vary 
toward one. When the minor axis equals zero and 
the major axisis finite, theratio also equals zero, 
the coefficient is one, no spread is present, and 
we have asingle straight line—with perfect corre- 
lation. (An exception occürs when the slope of the 
line representing the major axis equals zero. In 
this case, the Y variable equals a constant value 
for every X, and the line is parallel to the X axis. 
Thus, there is no change in Y with a change in X; 
Y remains the same. Inthis case, even though 
the minor axis is zero and the ratio is zero, the 
correlation coefficient would be zero because no 
relationship is present.) On the other hand, as the 
minor axis increases, with the major axis rela- 
tively fixed, the ratio increases and the coefficient 
decreases. When the minor axis is equal to the 
major axis, the ratio is one, the coefficient is 
zero, the spreadis maximal, and we have a circle 
with no relationship present. 

This geometrical interpretation has value be- 
yond the elementary teaching of correlation. For 
example, it is found useful in looking at the effects 
of range of ability in the sample on the size of the 
coefficient. Let us use an example in which 
500 Ss have scores on a college entrance examin- 
ation, all are accepted, grade-point averages are 
available later for each, and the relationship be- 
tween examination scores and grade-point average 
is.60. If one were to plot these data оп a corre- 
lation chart it would be foundthat a ratio of approx- 
imately 2/5 would occur. The ratio might be 
greater or less, but the magnitude of the ratio is 
not important for this example. Only the relative 
aspects are of consequence. Thus, let us assume 
that 2/5 is the ratio. This situation is shown in 
Figure l. Now if, instead of allowing all 500 ap- 
plicants to enter sc hool, we had used a cutting 
Score on the examination, the diagram would be 
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FIGURE 1 


А HYPOTHETICAL EXAMPLE IN WHICH ALL APPLI- 
CANTS ARE ACCEPTED AT A COLLEGE 


Grade Point Average (Y) 


r 


K 
Score on Entrance Examination (X) 


Note; The relationship indicated is . 60. The ratio of the 
minor axis (A) to the major axis (B) isassumedto ђе 2/5 
Point К represents the cutting Score whi chis used in 


Figure 2. 


FIGURE 2 


THE RELATIONSHIP INDICATED WHEN A NUMBER OF 
APPLICANTS TOWARD THE LOWER END OF THE x 
VARIABLE, BELOW К, HAVE BEEN ELIMINATED 


Grade Point Average (Y) 


K 
Score on Entrance Examination (X) 
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changed as in Figure 2. Note that the minor axis 
has been shifted from its position in Figure 1 so 
as to be perpendiculartothe major axis at the lat- 
ter's center; however, the minor axis is approxi- 
mately the same in magnitude as it was in Figure 
1. The major axis has decreased in size so that 
the ratio nowisapproximately 2/4. This increase 
in ratio would indicate a lesser degree of relation- 
shipthanis present іп Figure 1. Such а procedure 
easily illustrates the effect of composition of the 
sample (as indicated by the range of the X variable) 
on the magnitude of the relationship, with a great- 


er degree of relationship present when the sample 
is heterogeneous than when the sample is homo- 
geneous. 

We have not developed an exact mathematical 
relationship between the size of the ratio and the 
size of the correlation coefficient. Intuitively, 
however, we assume that there is such a relation- 
ship, so that one could indicate the size of the co- 
efficient by knowing the size of the ratio. This 
geometrical interpretationof correlation, using an 
elliptical ratio, should be useful for teaching pur- 
poses even if it is merely of an ordinal nature. 


